-- Logs begin at Tue 2021-08-31 12:56:13 UTC, end at Tue 2021-08-31 13:57:57 UTC. -- Aug 31 13:30:21.957305 dv-cinder-806605-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 13:30:21.966750 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 31 13:30:21 2021] *** Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: nodename: dv-cinder-806605-3-iscsi Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: machine: x86_64 Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: clock source: unix Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: pcre jit disabled Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: detected number of CPU cores: 4 Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: current working directory: / Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: detected binary path: /usr/bin/uwsgi-core Aug 31 13:30:21.968777 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: your processes number limit is 47680 Aug 31 13:30:21.969570 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: your memory page size is 4096 bytes Aug 31 13:30:21.969570 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: detected max file descriptor number: 2048 Aug 31 13:30:21.969570 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: lock engine: pthread robust mutexes Aug 31 13:30:21.969570 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: thunder lock: enabled Aug 31 13:30:21.969570 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 13:30:21.969570 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 31 13:30:22.013179 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: Python main interpreter initialized at 0x55e2cad4a9c0 Aug 31 13:30:22.013179 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: python threads support enabled Aug 31 13:30:22.013179 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: your server socket listen backlog is limited to 100 connections Aug 31 13:30:22.013179 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: your mercy for graceful operations on workers is 90 seconds Aug 31 13:30:22.013603 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 13:30:22.013603 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: *** Operational MODE: preforking *** Aug 31 13:30:22.013905 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: *** uWSGI is running in multiple interpreter mode *** Aug 31 13:30:22.013905 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: spawned uWSGI master process (pid: 94389) Aug 31 13:30:22.014151 dv-cinder-806605-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 13:30:22.014723 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: spawned uWSGI worker 1 (pid: 94390, cores: 1) Aug 31 13:30:22.016559 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: spawned uWSGI worker 2 (pid: 94391, cores: 1) Aug 31 13:30:22.016559 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 13:30:23.682018 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:30:23.682018 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: from cryptography.utils import int_from_bytes Aug 31 13:30:23.682796 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:30:23.682796 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: from cryptography.utils import int_from_bytes Aug 31 13:30:23.685938 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:30:23.685938 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: from cryptography.utils import int_from_bytes Aug 31 13:30:23.686432 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:30:23.686432 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: from cryptography.utils import int_from_bytes Aug 31 13:30:26.413822 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 13:30:26.414451 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 13:30:26.414570 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 13:30:26.414872 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 13:30:26.415109 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 13:30:26.415462 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.415642 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 13:30:26.416056 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.416144 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 13:30:26.416223 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.416356 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 13:30:26.416526 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.416722 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.416852 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 13:30:26.417006 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 13:30:26.417149 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.417310 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.417399 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.417616 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.417706 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.417932 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418026 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418184 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418281 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418490 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418579 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418789 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-3-iscsi {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.418886 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.419100 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.419194 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.419398 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.419499 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.419697 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.419783 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420005 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420099 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420304 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420427 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420637 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420723 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-3-iscsi {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.420938 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.421021 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.421260 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.421424 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.421568 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.422597 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.422693 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.422772 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.422848 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.422915 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.422989 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423055 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423119 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423225 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423447 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423563 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423672 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423762 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.423929 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424034 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424234 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424323 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424560 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424667 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424894 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.424997 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-3-iscsi {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.425205 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.425370 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.425523 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.425603 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.425810 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.425904 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.426143 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.426530 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.426678 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.426891 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.427286 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-3-iscsi {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.427434 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.427679 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.427966 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.428055 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.428418 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.428540 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.428775 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.429113 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.429456 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.429649 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.429809 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.430073 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.430073 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.430419 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.430583 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.430756 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.430896 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.431217 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.431325 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.431501 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.431830 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.432155 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.432516 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.432825 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.432954 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.433149 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.433333 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.433476 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.433619 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.433784 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.433914 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.436508 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.436508 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.436508 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437046 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437046 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437314 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437441 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437566 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437698 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437698 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.437965 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438096 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438096 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438368 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438552 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438651 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438651 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438811 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438895 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438985 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.438985 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439131 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439210 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439288 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439365 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439458 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439458 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439458 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439458 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439744 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.439822 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.440130 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.440456 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.440796 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.441115 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.441422 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.441738 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.442295 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.442582 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.442715 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.442930 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.443078 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.443232 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.443405 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.443578 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.443709 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.443889 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.444022 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.444212 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.444557 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.444871 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.445174 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446032 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446133 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446227 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446309 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446387 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446465 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446543 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446621 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446709 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446790 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.446867 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.447003 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.447257 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.447469 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.447559 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.447682 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.447832 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.448088 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.448168 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.448469 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.448553 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.448880 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.448972 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.449080 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.449169 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.449389 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.449471 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.449771 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.449858 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450088 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450181 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450343 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450424 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450662 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450751 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.450963 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.451054 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.451311 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.451544 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.451626 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.451695 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.451998 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452102 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452199 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452349 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452532 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452676 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452858 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.452964 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.453156 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.453368 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.453556 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.453703 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.453794 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.453938 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454028 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454106 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454358 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454501 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454677 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454867 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.454960 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.455040 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.455263 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.455403 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.455582 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.455768 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.455869 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.456148 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.456293 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.456493 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.456622 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.456784 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.456868 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.457080 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.457364 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.457364 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.457626 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.457722 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.457842 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.458052 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.458206 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.458336 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.458668 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.458814 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.459146 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.459321 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.459468 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.459616 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.459768 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.459889 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.460025 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.460160 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.460397 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.460635 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.460756 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.460939 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461031 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461226 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461312 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461527 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461703 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461842 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.461933 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.462145 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.462238 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.462448 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.462544 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.462751 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.462933 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.463075 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.463231 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.463364 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.463504 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.463675 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.463867 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.463998 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.464199 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.464340 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.464514 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.464647 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.464833 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.464964 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.465152 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.465295 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.465459 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.465624 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.465762 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.465941 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.466065 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.466254 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.466378 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:30:26.466601 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.466721 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.466888 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.467052 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.467198 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.467392 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.467507 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.467702 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.467818 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.468031 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.468117 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.468357 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.468511 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.468692 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.468777 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469003 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469088 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469315 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469398 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469636 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469719 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.469943 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470027 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470253 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470352 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470562 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470647 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470873 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.470958 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.471189 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.471273 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.471517 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.471600 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.471829 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.471914 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.472140 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.472247 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.472477 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.472575 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.472783 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.472868 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.473151 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.473238 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.473581 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.473674 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.473896 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.474173 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.474332 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.474472 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.474610 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.474802 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.474928 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.475109 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.475238 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.475437 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.475528 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.475761 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.475854 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.476071 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.476156 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.476408 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.476530 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.476728 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.476815 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477038 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477130 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477346 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477443 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477649 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477735 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.477955 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478040 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478262 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478362 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478571 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478654 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478893 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.478976 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.479197 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.479287 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.479497 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.479580 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.479800 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.479885 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.480103 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.480196 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.480432 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.480529 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.480738 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.480823 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481039 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481132 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481362 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481453 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481664 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481747 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.481967 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482052 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482283 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482366 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482605 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482726 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482888 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.482976 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.483190 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.483277 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.483496 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.483581 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.483800 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.483893 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.484115 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.484251 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.484442 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.484532 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.484752 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.484847 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485054 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485238 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485365 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485456 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485658 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485745 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.485960 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486045 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486270 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486363 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486577 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486697 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486890 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.486987 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.487193 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.487285 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.487501 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.487586 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.487803 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.487887 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.488104 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.488201 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.488423 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.488529 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.488811 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.488949 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.489174 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.489535 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.489535 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.489775 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.489917 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.490145 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.490239 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.490446 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.490534 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.490768 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.490843 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491165 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491274 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491377 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491496 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491678 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491753 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.491984 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.492113 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.492291 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.492468 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.492619 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.492761 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.492922 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.493106 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.493274 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.493440 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.493756 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.493829 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.494076 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.494288 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.494383 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.494696 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.494840 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.495002 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.495311 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.495444 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.495617 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.495844 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.495931 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.496225 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.496358 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.496562 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.497017 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.497110 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.497488 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.497580 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.497820 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.498033 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.498131 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.498443 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.498567 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.498746 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.499019 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.499122 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.499383 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.499518 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.499722 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.500166 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.500297 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.500440 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.500596 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.500707 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.500989 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.501351 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.501471 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.501573 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.501682 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.501805 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.501916 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502027 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502378 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502492 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502602 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502712 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502827 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.502943 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.503092 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.503202 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.503401 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.503517 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.503747 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.503870 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.504140 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.504296 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.504477 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.504645 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.504763 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.504959 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.505289 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.505397 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.505640 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.505800 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.505919 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.506149 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.506235 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.506523 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.506608 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.506833 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.506927 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.507138 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.507225 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.507445 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.507528 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.507747 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508086 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508180 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508323 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508432 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508544 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508737 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.508844 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509032 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509191 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509378 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509519 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509661 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509769 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.509994 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510128 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510281 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510375 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510580 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510673 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510881 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.510979 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.511186 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.511278 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.511509 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.511601 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.511815 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.511914 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.512132 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.512223 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.512474 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.512663 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.512755 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.512978 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513069 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513287 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513394 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513592 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513679 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513904 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.513997 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.514216 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.514365 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.514494 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.514619 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.514829 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.514959 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.515117 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.515214 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.515424 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.515508 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.515735 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.515817 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.516061 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.516147 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.516385 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.516523 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.516697 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.516844 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517010 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517152 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517315 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517460 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517624 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517778 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.517928 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.518093 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.518242 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.518401 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.518564 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.518744 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.518897 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519011 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519176 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519322 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519489 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519630 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519791 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.519982 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.520181 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.520349 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.520668 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.520773 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.520979 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.521226 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.521316 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.521574 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.521666 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.521889 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.521976 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.522189 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.522485 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.522570 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.522819 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.522912 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.523117 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.523207 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.523433 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.523518 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.523752 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.523861 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.524061 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.524187 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.524401 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.524539 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.524702 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.524867 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525009 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525186 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525352 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525477 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525623 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525784 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.525927 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.526114 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.526297 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.526496 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.526607 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.526806 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.526918 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.527109 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.527225 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.527413 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.527543 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.527716 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.527840 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.528024 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.528147 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.528326 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.528478 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.528988 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.529122 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.529312 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.529400 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.529616 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.529712 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.529929 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.530233 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.530318 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.530543 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.530635 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.530846 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.530944 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.531239 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.531338 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.531483 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.531563 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.531775 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.531852 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.532077 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.532158 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.532417 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.532553 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.532733 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.532839 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533032 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533127 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533342 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533469 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533637 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533733 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.533938 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534025 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534247 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534344 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534547 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534639 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534850 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.534937 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.535152 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.535248 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.535456 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.535569 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.535788 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.535878 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.536091 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.536224 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.536427 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.536732 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.536875 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.537166 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.537304 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.537480 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.537626 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.537786 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.537920 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.538091 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.538225 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.538379 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.538518 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.538700 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.538829 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539007 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539144 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539298 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539433 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539594 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539783 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.539912 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.540088 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.540223 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.540458 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.540592 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.540718 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.540861 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541019 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541195 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541328 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541510 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541635 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541815 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.541937 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.542117 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.542251 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.542437 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.542553 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.542738 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.542858 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543037 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543125 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543336 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543422 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543640 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543738 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.543945 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.544030 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.544244 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.544329 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.544578 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.544717 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.544888 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.545017 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.545240 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.545447 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.545644 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.545851 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.546045 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.546239 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.546435 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.546638 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.546775 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.547042 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.547240 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.547437 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.547584 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.547772 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.547923 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.548176 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.548448 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.548657 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.548799 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.549051 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.549276 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.549492 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.549713 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.549922 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550058 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550251 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550400 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550546 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550689 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550809 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.550924 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.551064 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.551335 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.551474 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.551870 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552017 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552153 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552286 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552457 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552592 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552723 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.552898 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553035 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553035 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553358 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553358 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553612 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553731 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.553848 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554000 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554131 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554264 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554397 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554530 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554666 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554813 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.554948 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555081 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555225 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555367 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555502 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555502 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555791 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.555924 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.556055 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.556186 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.556317 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.556664 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.556799 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.557277 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.557417 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.557551 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.557701 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.557835 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.557966 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558099 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558239 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558327 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558415 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558496 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558580 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558676 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558756 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558834 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558920 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558999 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.558999 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559146 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559224 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559301 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559301 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559451 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559573 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559659 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559780 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.559899 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560009 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560095 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560363 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560551 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560668 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560765 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.560981 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.561074 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.561293 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.561379 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.561606 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.561701 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.561915 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562001 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562222 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562307 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562531 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562628 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562839 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.562930 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.563137 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.563256 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.563439 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.563540 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.563754 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.563838 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564057 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564142 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564360 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564508 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564689 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564785 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.564999 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.565084 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.565302 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.565395 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.565601 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.565742 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.565905 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.566053 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.566211 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.566362 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.566521 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.566667 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.566895 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.567126 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.567674 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.567769 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.567769 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.567913 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568022 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568108 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568328 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568449 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568686 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568779 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.568994 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.569091 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.569301 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.569386 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.569608 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.569700 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.569915 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570083 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570218 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570303 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570539 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570624 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570846 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.570939 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.571147 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.571232 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.571451 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.571538 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.571757 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.571856 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.572065 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.572150 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.572388 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.572477 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.572711 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.572829 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.573130 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.573222 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.573437 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.573529 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.573738 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.573823 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574042 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574153 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574351 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574476 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574665 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574754 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.574978 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.575063 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.575279 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.575363 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.575676 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.575761 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.575981 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.576078 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.576287 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.576410 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.576620 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.576716 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.576922 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577005 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577223 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577318 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577531 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577616 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577843 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.577927 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.578142 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.578234 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.578444 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.578530 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.578748 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.578833 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.579065 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.579156 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.579365 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.579448 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.579681 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.579813 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.580092 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.580189 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.580417 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.580511 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.580721 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.580806 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581049 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581142 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581355 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581440 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581658 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581751 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.581967 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.582054 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.582272 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.582358 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.582743 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.582872 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.583233 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.583396 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.583529 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.583733 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.583818 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584045 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584270 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584422 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584530 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584672 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584762 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.584976 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.585065 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.585328 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.585436 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.585602 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.585690 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.585924 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586011 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586233 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586330 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586553 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586640 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586874 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.586961 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.587180 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.587290 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.587501 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.587604 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.587811 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.587900 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.588120 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.588217 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.588456 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.588559 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.588754 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.588844 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.589101 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.589190 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.589467 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.589577 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.589727 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.589828 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590004 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590146 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590325 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590453 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590634 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590795 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.590935 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591067 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591237 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591364 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591543 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591677 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591844 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.591971 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.592146 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.592273 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.592489 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.592636 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.592795 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.592930 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.593103 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.593236 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.593408 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.593521 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.593711 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.593839 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594012 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594139 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594318 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594451 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594617 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594753 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.594920 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595061 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595221 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595350 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595522 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595650 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595807 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.595933 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.596133 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.596261 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.596465 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.596594 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.596767 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.596910 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.597055 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.597192 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.597356 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.597483 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.597698 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.597831 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.598008 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.598237 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.598500 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.598659 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.598885 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.599097 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.599328 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.599505 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.599686 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.599905 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.600024 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.600563 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.600717 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.600854 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601067 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601067 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601339 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601485 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601573 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601573 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601826 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.601957 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602086 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602222 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602352 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602480 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602609 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602737 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.602865 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603005 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603135 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603272 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603408 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603567 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603709 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.603887 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.604211 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.604337 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.604539 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.604669 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.604845 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.604972 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.605148 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.605275 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.605491 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.605619 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.605793 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.605925 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.606123 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.606265 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.606432 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.606577 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.606744 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.606886 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.607053 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.607200 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.607360 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.607517 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.607684 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.607849 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.608007 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.608195 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.608335 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.608535 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.608676 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609026 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609149 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609339 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609448 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609652 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609855 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.609964 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.610177 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.610308 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.610599 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.610761 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.610873 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.611066 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.611176 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.611379 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.611496 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.611691 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.611799 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.612003 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.612261 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.612357 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.612619 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.612707 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.612935 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.613028 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.613245 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.613340 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.613554 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.613682 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.613934 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.614102 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.614242 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.614579 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.614714 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.614900 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615113 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615226 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615313 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615536 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615671 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615847 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.615981 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.616157 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.616304 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.616511 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.616644 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.616915 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617047 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617228 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617348 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617544 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617677 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617856 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.617994 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.618171 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.618307 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.618482 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.618615 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.618842 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.618980 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.619156 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.619285 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.619462 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.619589 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.619773 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.619912 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.620088 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.620226 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.620419 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.620533 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.620736 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.620877 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621018 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621149 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621322 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621449 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621624 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621759 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.621930 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.622060 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.622232 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.622358 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.622539 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.622764 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.622892 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.623114 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.623246 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.623431 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.623558 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.623926 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624060 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624060 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624254 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624383 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624472 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624697 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.624837 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.625189 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.625351 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.625473 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.625568 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.625775 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.625860 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626087 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626172 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626393 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626486 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626692 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626785 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.626992 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627077 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627298 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627391 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627600 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627686 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627904 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.627988 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.628208 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.628301 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.628531 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.628617 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.628839 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.628922 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.629153 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.629238 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.629502 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.629695 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.629803 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630014 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630120 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630333 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630419 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630644 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630746 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.630974 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.631175 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.631263 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.631522 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.631607 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.631838 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.631923 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.632161 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.632248 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.632507 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.632609 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.632823 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.632909 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.633127 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.633220 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.633443 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.633527 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.633742 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.633834 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634042 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634135 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634343 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634428 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634644 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634738 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.634943 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635028 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635243 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635328 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635550 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635644 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635855 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.635939 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.636156 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.636241 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.636495 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.636595 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.636798 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.636890 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.637121 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.637351 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.637445 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.637690 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.637776 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638001 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638105 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638308 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638411 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638608 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638692 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638910 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.638994 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.639212 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.639306 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.639510 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.639602 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.639820 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.639905 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.640118 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.640287 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.640442 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.640531 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.640746 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.640830 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641052 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641163 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641351 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641444 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641653 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641738 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.641954 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642047 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642259 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642389 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642557 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642641 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642856 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.642953 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.643158 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.643242 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.643461 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.643544 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.643776 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.643869 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.644085 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.644204 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.644402 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.644503 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.644722 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.644807 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.645093 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.645212 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.645420 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.645731 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.645899 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.646034 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.646238 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.646347 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.646579 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.646673 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.646918 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.647004 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.647255 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.647339 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.647561 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.647862 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.647954 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.648165 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.648249 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.648509 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.648598 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.648821 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.648911 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.649128 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.649220 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.649433 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.649527 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.649738 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.649824 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650041 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650132 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650346 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650441 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650650 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650743 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.650958 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.651092 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.651261 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.651403 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.651565 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.651745 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.651872 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652072 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652218 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652416 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652564 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652719 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652855 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.652991 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.653130 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.653291 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.653419 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.653626 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.654060 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.654290 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.654437 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.654612 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.654750 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.654924 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655081 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655239 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655373 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655547 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655672 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655862 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.655988 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.656170 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.656300 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.656508 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.656818 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.656954 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.657148 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.657303 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.657457 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.657583 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.657767 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.657892 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658071 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658168 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658376 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658503 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658683 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658809 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.658989 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.659126 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.659307 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.659444 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.659638 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.659768 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.659910 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.660036 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.660227 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.660353 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.660646 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.660788 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.661137 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.661266 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.661571 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.661690 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.661780 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.661931 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662067 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662238 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662376 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662549 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662690 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662884 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.662999 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.663200 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.663288 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.663521 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.663631 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.663875 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.663977 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.664150 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.664235 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.664480 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.664641 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.664801 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.664975 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.665119 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.665301 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.665434 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.665648 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.665772 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.665960 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.666045 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.666303 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.666389 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.666629 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.666715 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.666871 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94391) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 13:30:26.666965 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.667229 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.667536 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.667841 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.668163 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.668509 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.668810 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.669128 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.669442 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.669756 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.670067 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.670373 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.670698 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.671003 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.671314 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.671622 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.671923 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.672231 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.672570 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.672893 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.673211 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.673528 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.673850 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.674193 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.674542 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.674843 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.675165 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:30:26.675402 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=94390) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 13:30:26.689649 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:26.698262 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_db.sqlalchemy.engines [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:26.771437 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.context [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29c8b651-663d-4ed1-81b4-a3ed2cff61f0(cell1) {{(pid=94391) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 13:30:26.775664 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_concurrency.lockutils [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:30:26.777568 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_concurrency.lockutils [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:30:26.778389 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_concurrency.lockutils [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:30:26.780665 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_concurrency.lockutils [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=94391) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:30:26.799943 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.context [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29c8b651-663d-4ed1-81b4-a3ed2cff61f0(cell1) {{(pid=94390) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 13:30:26.805325 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:30:26.807915 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:30:26.809267 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:30:26.812685 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:30:26.889817 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:26.892252 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:26.930542 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_db.sqlalchemy.engines [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:26.932693 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_db.sqlalchemy.engines [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:27.154759 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG oslo_db.sqlalchemy.engines [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94391) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:27.203474 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_db.sqlalchemy.engines [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=94390) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:30:27.525536 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: WARNING keystonemiddleware.auth_token [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:30:27.532455 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: WARNING keystonemiddleware.auth_token [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:30:27.561995 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: WARNING keystonemiddleware.auth_token [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:30:27.570753 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: WARNING keystonemiddleware.auth_token [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:30:27.884763 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: WARNING keystonemiddleware.auth_token [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:30:27.890171 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: WARNING keystonemiddleware.auth_token [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:30:27.895885 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e2cad4a9c0 pid: 94391 (default app) Aug 31 13:30:27.898464 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:30:27.899684 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] 10.222.0.21 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001930 Aug 31 13:30:27.900090 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 1/1] 10.222.0.21 () {50 vars in 789 bytes} [Tue Aug 31 13:30:27 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:30:27.947469 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: WARNING keystonemiddleware.auth_token [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:30:27.956107 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: WARNING keystonemiddleware.auth_token [None req-68fe0ac0-d01d-4b71-acda-3183bb0bb66a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:30:27.963911 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55e2cad4a9c0 pid: 94390 (default app) Aug 31 13:31:52.997891 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:31:53.000667 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002702 Aug 31 13:31:53.001693 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 2/2] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:31:52 2021] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:31:53.467954 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-38645f24-9a65-4dd7-97e5-bc4e89289186 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:31:53.500731 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-38645f24-9a65-4dd7-97e5-bc4e89289186 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490881 Aug 31 13:31:53.503847 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 1/3] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 31 13:31:53 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:31:55.786098 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:31:55.787132 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-2d0f0734-5bba-41ea-a2e7-deda4f8f2721 None None] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 31 13:31:55.787505 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 3/4] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:31:55 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:31:55.850584 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-e6380098-3ebf-4bf1-99e8-5904962deb64 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "vcpus": 1, "os-flavor-access:is_public": true, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:31:55.868435 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:31:55.868435 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: warnings.warn(msg) Aug 31 13:31:55.911062 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-e6380098-3ebf-4bf1-99e8-5904962deb64 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.116732 Aug 31 13:31:55.911627 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 2/5] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:31:55 2021] POST /compute/v2.1/flavors => generated 407 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:31:56.196185 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-72f4466e-fe06-4578-b30c-e0768cd2404d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:31:56.198757 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:31:56.198757 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: warnings.warn(msg) Aug 31 13:31:56.257032 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-72f4466e-fe06-4578-b30c-e0768cd2404d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.334916 Aug 31 13:31:56.264699 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 4/6] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 31 13:31:55 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:31:58.596215 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-e6380098-3ebf-4bf1-99e8-5904962deb64 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:31:58.597545 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-e6380098-3ebf-4bf1-99e8-5904962deb64 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001951 Aug 31 13:31:58.597958 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 3/7] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:31:58 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:31:58.717114 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-28f90e01-b08d-4cdf-a790-6c9818dcd414 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds512M", "id": "d1", "vcpus": 1, "disk": 5, "ram": 512, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:31:58.735141 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:31:58.735141 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: warnings.warn(msg) Aug 31 13:31:58.762573 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-28f90e01-b08d-4cdf-a790-6c9818dcd414 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.156920 Aug 31 13:31:58.763424 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 5/8] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:31:58 2021] POST /compute/v2.1/flavors => generated 404 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:31:58.777573 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-17dd306a-5c4b-46a9-8319-e42229f4397b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:31:58.779787 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:31:58.779787 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: warnings.warn(msg) Aug 31 13:31:58.817112 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-17dd306a-5c4b-46a9-8319-e42229f4397b admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044273 Aug 31 13:31:58.818733 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 4/9] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 31 13:31:58 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:01.092961 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-28f90e01-b08d-4cdf-a790-6c9818dcd414 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:01.094416 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-28f90e01-b08d-4cdf-a790-6c9818dcd414 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 Aug 31 13:32:01.095171 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 6/10] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:01 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:01.172752 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-96c91dac-f852-4c94-a9ba-02e7225cf58d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "rxtx_factor": 1.0, "id": "d2", "swap": 0, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:01.193835 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-96c91dac-f852-4c94-a9ba-02e7225cf58d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091519 Aug 31 13:32:01.196423 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 5/11] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:01 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:32:01.208050 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-a9a079fd-1b66-43f8-be0f-c132c09d1180 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:01.234963 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-a9a079fd-1b66-43f8-be0f-c132c09d1180 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031195 Aug 31 13:32:01.235713 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 7/12] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 31 13:32:01 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:03.581002 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-96c91dac-f852-4c94-a9ba-02e7225cf58d admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:03.582065 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-96c91dac-f852-4c94-a9ba-02e7225cf58d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001548 Aug 31 13:32:03.582472 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 6/13] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:03 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:03.649771 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-facaf2a3-0d55-4256-8442-56703d488d6a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 10, "name": "ds2G", "id": "d3", "rxtx_factor": 1.0, "ram": 2048}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:03.681250 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-facaf2a3-0d55-4256-8442-56703d488d6a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091744 Aug 31 13:32:03.681826 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 8/14] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:03 2021] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:32:03.694706 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-404cd10c-8c1f-495b-aaf3-61fc365031dd admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:03.734203 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-404cd10c-8c1f-495b-aaf3-61fc365031dd admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.043165 Aug 31 13:32:03.734792 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 7/15] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 31 13:32:03 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:06.051244 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-facaf2a3-0d55-4256-8442-56703d488d6a admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:06.052265 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-facaf2a3-0d55-4256-8442-56703d488d6a admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 13:32:06.052809 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 9/16] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:06 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:06.112760 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-9908e8d3-fa50-4fbc-afda-669c20754e6d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "ram": 4096, "id": "d4", "disk": 20, "swap": 0, "os-flavor-access:is_public": true, "name": "ds4G"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:06.132457 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-9908e8d3-fa50-4fbc-afda-669c20754e6d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.072631 Aug 31 13:32:06.132999 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 8/17] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:06 2021] POST /compute/v2.1/flavors => generated 404 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:32:06.146123 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-0230b04a-c924-492b-97b7-7a50560a85e7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:06.173512 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-0230b04a-c924-492b-97b7-7a50560a85e7 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031185 Aug 31 13:32:06.174159 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 10/18] 10.222.0.21 () {64 vars in 1336 bytes} [Tue Aug 31 13:32:06 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:08.460781 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-9908e8d3-fa50-4fbc-afda-669c20754e6d admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:08.461789 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-9908e8d3-fa50-4fbc-afda-669c20754e6d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001580 Aug 31 13:32:08.462195 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 9/19] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:08 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:32:08.526238 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-1e7a1a9a-cc73-4a8c-8bf3-409761600e82 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:08.551532 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-1e7a1a9a-cc73-4a8c-8bf3-409761600e82 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.082353 Aug 31 13:32:08.552061 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 11/20] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 31 13:32:08 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:32:11.109951 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-9908e8d3-fa50-4fbc-afda-669c20754e6d admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:11.111295 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-9908e8d3-fa50-4fbc-afda-669c20754e6d admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002106 Aug 31 13:32:11.111777 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 10/21] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:11 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:11.178015 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-e023f308-d0b9-40e1-9908-568b775f03f8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "swap": 0, "name": "m1.tiny", "ram": 512, "id": "1", "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:11.198688 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-e023f308-d0b9-40e1-9908-568b775f03f8 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.079836 Aug 31 13:32:11.199277 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 12/22] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:11 2021] POST /compute/v2.1/flavors => generated 402 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:32:11.212859 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-0243077b-90db-4f09-9878-8133246366bc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:11.241226 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-0243077b-90db-4f09-9878-8133246366bc admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032953 Aug 31 13:32:11.241843 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 11/23] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 31 13:32:11 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:13.489377 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-e023f308-d0b9-40e1-9908-568b775f03f8 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:13.490389 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-e023f308-d0b9-40e1-9908-568b775f03f8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 31 13:32:13.490943 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 13/24] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:13.556911 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-05615c00-2dea-4d53-bbc6-3c970034d8bf admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 1, "ram": 2048, "name": "m1.small", "os-flavor-access:is_public": true}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:13.579557 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-05615c00-2dea-4d53-bbc6-3c970034d8bf admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.082030 Aug 31 13:32:13.580189 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 12/25] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:13 2021] POST /compute/v2.1/flavors => generated 405 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:32:13.593567 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-30c32ae1-f35c-4a7e-8321-6803e897c06e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:13.619479 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-30c32ae1-f35c-4a7e-8321-6803e897c06e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030043 Aug 31 13:32:13.620127 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 14/26] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 31 13:32:13 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:32:15.898042 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-05615c00-2dea-4d53-bbc6-3c970034d8bf admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:15.899927 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-05615c00-2dea-4d53-bbc6-3c970034d8bf admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003204 Aug 31 13:32:15.911072 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 13/27] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:15 2021] GET /compute/v2.1 => generated 388 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:15.988336 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-bb9abeaa-41e7-43ed-b49f-38eb90a6b217 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 40, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "ram": 4096, "os-flavor-access:is_public": true, "name": "m1.medium"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:16.025075 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-bb9abeaa-41e7-43ed-b49f-38eb90a6b217 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.105053 Aug 31 13:32:16.028589 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 15/28] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:15 2021] POST /compute/v2.1/flavors => generated 406 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:32:16.039364 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-27206737-6d88-4064-bfeb-924427ce9955 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:16.066923 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-27206737-6d88-4064-bfeb-924427ce9955 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031907 Aug 31 13:32:16.067538 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 31 13:32:16 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:18.494306 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-bb9abeaa-41e7-43ed-b49f-38eb90a6b217 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:18.496042 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-bb9abeaa-41e7-43ed-b49f-38eb90a6b217 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002088 Aug 31 13:32:18.497048 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 16/30] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:18 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:18.573603 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-03547441-eb7a-4ee0-b6c9-bb34ec014a4a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "disk": 80, "vcpus": 4, "id": "4", "swap": 0, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:18.601730 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-03547441-eb7a-4ee0-b6c9-bb34ec014a4a admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.094107 Aug 31 13:32:18.602415 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 15/31] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:18 2021] POST /compute/v2.1/flavors => generated 405 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:32:18.618109 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-adbf2e0f-af87-4b88-92b2-611afe5f3288 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:18.651548 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-adbf2e0f-af87-4b88-92b2-611afe5f3288 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039405 Aug 31 13:32:18.652752 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 17/32] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 31 13:32:18 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:32:21.056394 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-03547441-eb7a-4ee0-b6c9-bb34ec014a4a admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:32:21.060363 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-03547441-eb7a-4ee0-b6c9-bb34ec014a4a admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.004571 Aug 31 13:32:21.061246 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 16/33] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:32:21 2021] GET /compute/v2.1 => generated 388 bytes in 6 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:32:21.142709 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-d92d5eb0-7e7e-4dc6-97d8-e2d02488815c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 16384, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:21.172987 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-d92d5eb0-7e7e-4dc6-97d8-e2d02488815c admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.100371 Aug 31 13:32:21.173855 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 18/34] 10.222.0.21 () {64 vars in 1283 bytes} [Tue Aug 31 13:32:21 2021] POST /compute/v2.1/flavors => generated 408 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:32:21.186908 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-7fc9cde7-c07e-4c65-ad82-49f3d542219d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:32:21.218784 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-7fc9cde7-c07e-4c65-ad82-49f3d542219d admin admin] 10.222.0.21 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.035639 Aug 31 13:32:21.235924 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 17/35] 10.222.0.21 () {64 vars in 1333 bytes} [Tue Aug 31 13:32:21 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:33:02.281226 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-d92d5eb0-7e7e-4dc6-97d8-e2d02488815c admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:02.282234 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-d92d5eb0-7e7e-4dc6-97d8-e2d02488815c admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001514 Aug 31 13:33:02.282649 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 19/36] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:33:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:02.365256 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-37c6b73e-631b-4101-b466-d9ae4c08d264 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:02.385785 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-37c6b73e-631b-4101-b466-d9ae4c08d264 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.095291 Aug 31 13:33:02.386338 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 18/37] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 31 13:33:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:03.847525 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-d92d5eb0-7e7e-4dc6-97d8-e2d02488815c admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:03.848562 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-d92d5eb0-7e7e-4dc6-97d8-e2d02488815c admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 13:33:03.848979 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 20/38] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:03 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:04.046481 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-f0c1779a-d37d-4912-bd06-c1ab2db96f95 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:04.052321 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.wsgi [None req-f0c1779a-d37d-4912-bd06-c1ab2db96f95 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 13:33:04.052979 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-f0c1779a-d37d-4912-bd06-c1ab2db96f95 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:33:04.053717 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-f0c1779a-d37d-4912-bd06-c1ab2db96f95 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.064545 Aug 31 13:33:04.054459 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 19/39] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 31 13:33:03 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 13:33:04.067336 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-8b1066eb-d8d3-4ca0-a304-c28bb0eb9518 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:04.096165 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-8b1066eb-d8d3-4ca0-a304-c28bb0eb9518 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.034627 Aug 31 13:33:04.096838 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 21/40] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 31 13:33:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:04.112032 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-87ca4a59-5286-4ecb-8703-7c26b7af10c6 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:04.135865 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-87ca4a59-5286-4ecb-8703-7c26b7af10c6 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.029123 Aug 31 13:33:04.136459 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 20/41] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 31 13:33:04 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:04.149322 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9f27e155-2300-4639-b0ec-07739436465c admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:04.154969 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.wsgi [None req-9f27e155-2300-4639-b0ec-07739436465c admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 31 13:33:04.155530 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9f27e155-2300-4639-b0ec-07739436465c admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:33:04.156320 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-9f27e155-2300-4639-b0ec-07739436465c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.012402 Aug 31 13:33:04.156848 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 22/42] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 31 13:33:04 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 13:33:05.556947 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-87ca4a59-5286-4ecb-8703-7c26b7af10c6 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:05.557957 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-87ca4a59-5286-4ecb-8703-7c26b7af10c6 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 Aug 31 13:33:05.558347 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 21/43] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:05 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:05.754348 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-1078174d-6e05-417b-a98f-a17cb34ab730 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:05.760487 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.wsgi [None req-1078174d-6e05-417b-a98f-a17cb34ab730 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 13:33:05.761057 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-1078174d-6e05-417b-a98f-a17cb34ab730 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:33:05.761848 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-1078174d-6e05-417b-a98f-a17cb34ab730 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.066486 Aug 31 13:33:05.762339 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 23/44] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 31 13:33:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 13:33:05.772671 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-bbf0cc36-c01d-4b4b-8d9d-e4ea2459d24d admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:05.786604 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-bbf0cc36-c01d-4b4b-8d9d-e4ea2459d24d admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017514 Aug 31 13:33:05.787202 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 22/45] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 31 13:33:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:05.798095 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-2dc7a5af-ccb9-4b8a-8ab3-b1ee0685f263 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:05.812530 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-2dc7a5af-ccb9-4b8a-8ab3-b1ee0685f263 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017922 Aug 31 13:33:05.813022 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 24/46] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 31 13:33:05 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:05.823661 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-67777d3f-e8e8-47ae-b8f8-4c4f526aac34 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:05.829110 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.wsgi [None req-67777d3f-e8e8-47ae-b8f8-4c4f526aac34 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 31 13:33:05.829668 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-67777d3f-e8e8-47ae-b8f8-4c4f526aac34 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:33:05.830454 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-67777d3f-e8e8-47ae-b8f8-4c4f526aac34 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.010864 Aug 31 13:33:05.830947 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 23/47] 10.222.0.21 () {60 vars in 1191 bytes} [Tue Aug 31 13:33:05 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 13:33:07.215783 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-2dc7a5af-ccb9-4b8a-8ab3-b1ee0685f263 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:07.216822 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-2dc7a5af-ccb9-4b8a-8ab3-b1ee0685f263 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Aug 31 13:33:07.217234 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 25/48] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:07 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:07.428470 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-c8777d98-4a4a-4087-9ef6-462a6bc39fda admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:07.434692 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.wsgi [None req-c8777d98-4a4a-4087-9ef6-462a6bc39fda admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 13:33:07.435248 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-c8777d98-4a4a-4087-9ef6-462a6bc39fda admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94390) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:33:07.436035 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-c8777d98-4a4a-4087-9ef6-462a6bc39fda admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.064411 Aug 31 13:33:07.436560 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 24/49] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 31 13:33:07 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 13:33:07.446725 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-52417671-98f7-4c7b-aaf5-41fb5528409c admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:07.460305 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-52417671-98f7-4c7b-aaf5-41fb5528409c admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017230 Aug 31 13:33:07.460896 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 26/50] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 31 13:33:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:07.473628 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:07.488708 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.018836 Aug 31 13:33:07.489245 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 25/51] 10.222.0.21 () {60 vars in 1211 bytes} [Tue Aug 31 13:33:07 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:33:07.499776 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-018af8b5-2806-4e2f-bc22-4b4ca74a4afc admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:07.505387 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.wsgi [None req-018af8b5-2806-4e2f-bc22-4b4ca74a4afc admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 31 13:33:07.505945 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-018af8b5-2806-4e2f-bc22-4b4ca74a4afc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=94391) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:33:07.506721 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-018af8b5-2806-4e2f-bc22-4b4ca74a4afc admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010634 Aug 31 13:33:07.507225 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 27/52] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 31 13:33:07 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 31 13:33:08.920518 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:08.922189 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002430 Aug 31 13:33:08.922627 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 26/53] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:08 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:09.136665 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-d075b8c7-b4c3-4952-a43f-13c3988a192e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:33:09.163541 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-d075b8c7-b4c3-4952-a43f-13c3988a192e admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.097398 Aug 31 13:33:09.164201 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 28/54] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 31 13:33:09 2021] POST /compute/v2.1/flavors => generated 404 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:33:10.548510 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:10.549538 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Aug 31 13:33:10.549934 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 27/55] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:10 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:10.751599 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-63c10883-b762-4b5f-b30d-b3b089a4c233 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:33:10.777498 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-63c10883-b762-4b5f-b30d-b3b089a4c233 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.089222 Aug 31 13:33:10.778046 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 29/56] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 31 13:33:10 2021] POST /compute/v2.1/flavors => generated 405 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:33:12.222581 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:12.224031 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001898 Aug 31 13:33:12.224433 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 28/57] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:12 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:12.451940 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-6f2896c4-c082-4c28-8c13-f31156cfcade admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:33:12.473468 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-6f2896c4-c082-4c28-8c13-f31156cfcade admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.088908 Aug 31 13:33:12.474020 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 30/58] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 31 13:33:12 2021] POST /compute/v2.1/flavors => generated 407 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:33:13.857293 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:13.858330 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Aug 31 13:33:13.858709 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 29/59] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:13 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:14.055639 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-4b00551e-200d-44a6-b33e-54be8a1ba3c3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:33:14.083057 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-4b00551e-200d-44a6-b33e-54be8a1ba3c3 admin admin] 10.222.0.21 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.081195 Aug 31 13:33:14.083792 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 31/60] 10.222.0.21 () {64 vars in 1236 bytes} [Tue Aug 31 13:33:14 2021] POST /compute/v2.1/flavors => generated 409 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:33:15.473083 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:15.474130 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 Aug 31 13:33:15.474543 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 30/61] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:33:15 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:33:15.679856 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-094305c9-66eb-4ec1-a101-0310cc14834a admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:33:15.700032 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-094305c9-66eb-4ec1-a101-0310cc14834a admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.082994 Aug 31 13:33:15.700599 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 32/62] 10.222.0.21 () {60 vars in 1203 bytes} [Tue Aug 31 13:33:15 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:34:02.277874 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:34:02.278885 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-147e97e0-47fd-4d81-9177-31b01caa0529 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Aug 31 13:34:02.279289 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 31/63] 10.222.0.21 () {54 vars in 931 bytes} [Tue Aug 31 13:34:02 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:34:02.356110 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-ccce8b24-5cd8-474b-9a80-8db0ebe684b6 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:34:02.382657 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-ccce8b24-5cd8-474b-9a80-8db0ebe684b6 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.093005 Aug 31 13:34:02.383191 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 33/64] 10.222.0.21 () {60 vars in 1292 bytes} [Tue Aug 31 13:34:02 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:34:02.407407 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-0c0f60f1-b182-4b78-93d6-8e963ea4f8f0 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:34:02.415803 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-0c0f60f1-b182-4b78-93d6-8e963ea4f8f0 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013441 Aug 31 13:34:02.416346 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 32/65] 10.222.0.21 () {60 vars in 1283 bytes} [Tue Aug 31 13:34:02 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:34:02.429327 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-acac2c44-8077-47ae-92ef-a6285e996f50 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:34:02.437588 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-acac2c44-8077-47ae-92ef-a6285e996f50 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011896 Aug 31 13:34:02.438123 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 34/66] 10.222.0.21 () {60 vars in 1286 bytes} [Tue Aug 31 13:34:02 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:34:02.452758 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-9788e602-a457-4cd4-885d-fde3cb8d041b admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:34:02.461008 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-9788e602-a457-4cd4-885d-fde3cb8d041b admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013735 Aug 31 13:34:02.461540 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 33/67] 10.222.0.21 () {60 vars in 1286 bytes} [Tue Aug 31 13:34:02 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:34:02.475583 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:34:02.484540 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] 10.222.0.21 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012042 Aug 31 13:34:02.485105 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 35/68] 10.222.0.21 () {60 vars in 1283 bytes} [Tue Aug 31 13:34:02 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:35:24.488755 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-db2c3be5-190e-445a-824b-b3df22714eab tempest-verify_tempest_config-1480857056 tempest-verify_tempest_config-1480857056-project] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:35:24.490732 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-db2c3be5-190e-445a-824b-b3df22714eab tempest-verify_tempest_config-1480857056 tempest-verify_tempest_config-1480857056-project] 10.222.0.21 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.127661 Aug 31 13:35:24.491282 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 34/69] 10.222.0.21 () {58 vars in 1134 bytes} [Tue Aug 31 13:35:24 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:36:56.092689 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:36:56.093704 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001527 Aug 31 13:36:56.094239 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 36/70] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:36:56 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:36:56.391951 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-41a50c8d-5ac6-47ab-b60b-91546037f9d4 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:36:56.393209 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:36:56.393209 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: warnings.warn(msg) Aug 31 13:36:56.395112 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-41a50c8d-5ac6-47ab-b60b-91546037f9d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:36:56.395540 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-41a50c8d-5ac6-47ab-b60b-91546037f9d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:36:56.396319 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-41a50c8d-5ac6-47ab-b60b-91546037f9d4 admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:36:56.396763 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-41a50c8d-5ac6-47ab-b60b-91546037f9d4 admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:36:56.431368 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-41a50c8d-5ac6-47ab-b60b-91546037f9d4 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.176201 Aug 31 13:36:56.431991 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 35/71] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 31 13:36:56 2021] GET /compute/v2.1/os-services => generated 791 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:36:57.851600 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:36:57.852634 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 31 13:36:57.853034 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 37/72] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:36:57 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:36:58.062378 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-a5994d38-7733-4ec3-97ee-bd718098d5ca admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:36:58.063618 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:36:58.063618 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: warnings.warn(msg) Aug 31 13:36:58.066206 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-a5994d38-7733-4ec3-97ee-bd718098d5ca admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:36:58.066632 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-a5994d38-7733-4ec3-97ee-bd718098d5ca admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:36:58.067436 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-a5994d38-7733-4ec3-97ee-bd718098d5ca admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:36:58.067868 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-a5994d38-7733-4ec3-97ee-bd718098d5ca admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:36:58.088980 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-a5994d38-7733-4ec3-97ee-bd718098d5ca admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.88 time: 0.087213 Aug 31 13:36:58.089798 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 36/73] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 31 13:36:57 2021] GET /compute/v2.1/os-services => generated 791 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:37:09.912049 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:37:09.913182 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001524 Aug 31 13:37:09.913564 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 38/74] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:37:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:37:10.118885 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-76936735-9a8a-4ab1-8520-034f75621e16 admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:37:10.120034 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:37:10.120034 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: warnings.warn(msg) Aug 31 13:37:10.121562 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-76936735-9a8a-4ab1-8520-034f75621e16 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:37:10.122002 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-76936735-9a8a-4ab1-8520-034f75621e16 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:37:10.122813 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-76936735-9a8a-4ab1-8520-034f75621e16 admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:37:10.123235 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-76936735-9a8a-4ab1-8520-034f75621e16 admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:37:10.147500 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-76936735-9a8a-4ab1-8520-034f75621e16 admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.089778 Aug 31 13:37:10.148050 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 37/75] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 31 13:37:10 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:37:11.531104 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: DEBUG nova.api.openstack.wsgi [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] Calling method '>' {{(pid=94391) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:37:11.532114 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: INFO nova.api.openstack.requestlog [None req-9b7a8323-fccd-4b2e-8b3a-36cb79d9e0e8 admin admin] 10.222.0.21 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001474 Aug 31 13:37:11.532562 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: [pid: 94391|app: 0|req: 39/76] 10.222.0.21 () {56 vars in 1075 bytes} [Tue Aug 31 13:37:11 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:37:11.738940 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG nova.api.openstack.wsgi [None req-1e8aa538-3d94-4827-bff0-294aa9f69b6a admin admin] Calling method '>' {{(pid=94390) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:37:11.740059 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:37:11.740059 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: warnings.warn(msg) Aug 31 13:37:11.741610 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-1e8aa538-3d94-4827-bff0-294aa9f69b6a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:37:11.742050 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-1e8aa538-3d94-4827-bff0-294aa9f69b6a admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:37:11.742809 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-1e8aa538-3d94-4827-bff0-294aa9f69b6a admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:37:11.743225 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: DEBUG oslo_concurrency.lockutils [None req-1e8aa538-3d94-4827-bff0-294aa9f69b6a admin admin] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=94390) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:37:11.764497 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: INFO nova.api.openstack.requestlog [None req-1e8aa538-3d94-4827-bff0-294aa9f69b6a admin admin] 10.222.0.21 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.88 time: 0.092412 Aug 31 13:37:11.765072 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: [pid: 94390|app: 0|req: 38/77] 10.222.0.21 () {60 vars in 1194 bytes} [Tue Aug 31 13:37:11 2021] GET /compute/v2.1/os-services => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:38:09.982035 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: Tue Aug 31 13:38:09 2021 - graceful shutdown triggered... Aug 31 13:38:09.982713 dv-cinder-806605-3-iscsi devstack@n-api.service[94391]: Gracefully killing worker 2 (pid: 94391)... Aug 31 13:38:09.983176 dv-cinder-806605-3-iscsi devstack@n-api.service[94390]: Gracefully killing worker 1 (pid: 94390)... Aug 31 13:38:09.984968 dv-cinder-806605-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 31 13:38:10.983133 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: worker 1 buried after 1 seconds Aug 31 13:38:10.983133 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: worker 2 buried after 1 seconds Aug 31 13:38:10.983133 dv-cinder-806605-3-iscsi devstack@n-api.service[94389]: goodbye to uWSGI. Aug 31 13:38:10.984836 dv-cinder-806605-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 31 13:38:10.985727 dv-cinder-806605-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 31 13:38:10.988600 dv-cinder-806605-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 31 13:38:10.999459 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Aug 31 13:38:10 2021] *** Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: nodename: dv-cinder-806605-3-iscsi Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: machine: x86_64 Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: clock source: unix Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: pcre jit disabled Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: detected number of CPU cores: 4 Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: current working directory: / Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: detected binary path: /usr/bin/uwsgi-core Aug 31 13:38:11.001567 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: your processes number limit is 47680 Aug 31 13:38:11.002310 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: your memory page size is 4096 bytes Aug 31 13:38:11.002310 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: detected max file descriptor number: 2048 Aug 31 13:38:11.002310 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: lock engine: pthread robust mutexes Aug 31 13:38:11.002310 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: thunder lock: enabled Aug 31 13:38:11.002310 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 31 13:38:11.002310 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 31 13:38:11.050178 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: Python main interpreter initialized at 0x560eceb809c0 Aug 31 13:38:11.050178 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: python threads support enabled Aug 31 13:38:11.050178 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: your server socket listen backlog is limited to 100 connections Aug 31 13:38:11.050178 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: your mercy for graceful operations on workers is 90 seconds Aug 31 13:38:11.050702 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: mapped 403077 bytes (393 KB) for 2 cores Aug 31 13:38:11.050702 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: *** Operational MODE: preforking *** Aug 31 13:38:11.054559 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: *** uWSGI is running in multiple interpreter mode *** Aug 31 13:38:11.054559 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: spawned uWSGI master process (pid: 120168) Aug 31 13:38:11.054559 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: spawned uWSGI worker 1 (pid: 120180, cores: 1) Aug 31 13:38:11.054559 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: spawned uWSGI worker 2 (pid: 120181, cores: 1) Aug 31 13:38:11.054559 dv-cinder-806605-3-iscsi devstack@n-api.service[120168]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 31 13:38:11.051030 dv-cinder-806605-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 31 13:38:12.950636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:38:12.950636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: from cryptography.utils import int_from_bytes Aug 31 13:38:12.951419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:38:12.951419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: from cryptography.utils import int_from_bytes Aug 31 13:38:13.013023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:38:13.013023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: from cryptography.utils import int_from_bytes Aug 31 13:38:13.013023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 31 13:38:13.013023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: from cryptography.utils import int_from_bytes Aug 31 13:38:15.923513 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 13:38:15.924127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 13:38:15.924127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 13:38:15.924667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 13:38:15.924667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 13:38:15.925070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.925405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.925736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.926158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.926952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.927376 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.928716 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.928716 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.928900 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.929088 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.929589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.930156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-3-iscsi {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.930698 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.931327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.931747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.932301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.932871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.933418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.933948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.934854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.935921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.936558 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.937098 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.937681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.938362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.939161 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.939446 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.939760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.940501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.942110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.942110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-3-iscsi {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.942110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.942110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.942595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.942873 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.943178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.943499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.943830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.944162 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.944506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.944841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.945166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.945508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.945829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.946132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.946454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.946770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.947623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.948014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.948405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.948685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.949008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.949367 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.950206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.950386 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.950721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.951160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.951746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.952639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.953179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.953741 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.954077 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.954403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.954726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.955897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.955897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.955897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.956579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.956948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.957300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.957719 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.958315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.959142 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.959363 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.959741 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.960365 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.961467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.962016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.962641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.963196 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.963798 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.964488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.964979 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.965593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.966206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.966785 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.967228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.967803 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.968435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.968714 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.969266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.969600 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.969928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.970254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.970584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.971254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.971577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.971900 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.972217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.972566 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.972882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.973199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.973515 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.973849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.974182 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.974495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.977787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.978897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.978897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.978897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.979521 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.979863 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.980931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.980931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.981368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.981586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.981969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.982360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.982986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.982986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.983408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.983720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.984087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.984508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.985126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.985647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.986090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.986542 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.987106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.987508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:15.987910 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.989473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.989473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.989473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.989746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.990841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.991207 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.991792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.992224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.992665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.993030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.993516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.993846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.994258 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.994584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.995050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.995388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.995885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.996275 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.996767 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.998300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.998300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.998643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.998969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:15.999740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.000486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.003636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.004449 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.005049 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.005574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.006176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.006752 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.007341 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.007930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.008736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.009064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.009684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.010288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.011230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.011742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.012676 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.013248 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.014048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.014539 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.015144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.015662 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.016297 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.016930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.017834 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.018606 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.019237 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.019753 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.020320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.020914 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.021506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.022117 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.022697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.023232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.023790 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.024342 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.024943 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.025510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.026093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.026830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.027508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.028153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.028750 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.029387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.029933 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.030498 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.031086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.031667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.032239 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.032942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.033485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.034033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.034570 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.035208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.035686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.036431 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.037012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.037601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.038137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.038655 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.039223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.039924 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.041146 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.041672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.041672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.041672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.041672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.044171 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.044718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.045487 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.046235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.046811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.048106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.048888 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.049273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.050968 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.051137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.051584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.052229 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.052755 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.053360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.053919 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.054529 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.055108 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.057368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.057368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.057368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.057904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.058026 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.058582 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.059065 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.059478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.059816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.060260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.060638 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.061112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.061446 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.061827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.062199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.062603 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.063108 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.063498 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.063932 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.064312 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.064658 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.065022 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.065486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.065922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.066291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.066637 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.067010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.067330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.067704 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.068156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.068509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.068880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.069268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.069619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.069935 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.070263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.070711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.070894 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.071213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.071586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.072014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.072410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.072747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.073070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.073401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.073814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.074163 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.074480 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.074812 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.075439 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.075963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.076539 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.077059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.077477 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.077812 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.078129 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.078458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.078870 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.080327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.080327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.080327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.080327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.080694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.081006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.081490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.081651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.081912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.083982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.083982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.083982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.083982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.083982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.083982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.086679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.087257 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.087566 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.087922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.088428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.088771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.089091 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.089580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.089818 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.090192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.090512 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.090827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.091197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.091527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.091842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.092190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.092524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.092844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.093159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.093532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.093854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.094212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.094854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.094854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.095682 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.096245 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.096497 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.096885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.097433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.097820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.098273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.098701 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.099052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.099388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.100806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.100806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.100806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.102795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.102795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.102795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.102795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.102795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.103706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.103706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.103706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.104271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.104271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.104581 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.104781 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.105063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.105443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.105749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.106108 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.106518 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.106764 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.106971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.107410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.107680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.107938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.108301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.108676 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.109141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.109366 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.109731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.110048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.110488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.112068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.112667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.113322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.113555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.114473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.114473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.114473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.125727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 31 13:38:16.126222 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 31 13:38:16.126395 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126395 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126553 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 31 13:38:16.126626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 31 13:38:16.126846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 31 13:38:16.126997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.126997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.127163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.127243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.127243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.127380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.127460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.127532 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.127601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.127678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.127678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.127814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.127886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.127955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.128024 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.128155 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.128267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.128267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.128510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.128603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.128678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.128748 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.128832 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.128832 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.128969 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-806605-3-iscsi {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.129048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.129120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.129190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.129270 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.129360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.129360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.129360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.130347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.130505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.130505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.130823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.130963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.130963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.131180 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.131301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.131301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.131507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.131652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.131652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.131865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.132011 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.132156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.132476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.133230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.133388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.133518 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.133639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.133759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.133992 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.134889 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.135401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.135578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.135578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.135867 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.136351 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.136547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.136701 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.136876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.137296 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.137448 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.137592 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.137736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.137887 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.138104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.138259 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.138458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.138787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.139100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-806605-3-iscsi {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.139264 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.139409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.139818 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.139986 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.140150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.140445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.140634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.140816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.140970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.141203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.141509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.141819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.142293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.142619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.143167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.143624 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.143624 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.145017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.145017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.145017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.145017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.145648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.145813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.145975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.145975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.146257 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.146400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.146544 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.146710 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.146853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.146993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.147142 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.147347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.147505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.147702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.148007 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.148175 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.148359 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.148546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.148722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.148882 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.149136 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.149286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.149465 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.149997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.150177 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.150331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.150639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.150804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.150954 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.151096 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.151248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.151487 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.151724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.151873 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.157249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.157559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.157801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.157801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.158244 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.158413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.158413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.158800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.159018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.159018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.159447 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.159613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.159613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.159912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.160084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.160349 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.160551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.160551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.160843 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.162981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.162981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.163304 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.163469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.163469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.163772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.165101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.165270 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.165421 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.165576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.165722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.21 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.165875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.166027 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.21 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.166178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.166321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.166462 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.166637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.166637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.167865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.168019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.168162 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.168312 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.168569 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.168809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.169045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.169285 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.169506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.169726 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.169965 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.170215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.170538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.170707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.170859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.171003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.171161 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.171304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.171304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.171572 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.171713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.171862 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.172013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.172162 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.172381 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.172562 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.172789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.173027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.173310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.173488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.173641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.173794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.173938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.174089 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.174232 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.174379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.174534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.174683 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.174835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.174987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.175303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.175446 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.175588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.175729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.175900 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.176217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.176395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.176395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.176684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.176858 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.177069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.177558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.177558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.178122 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.178274 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.178417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.178572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.178714 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.178854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.178996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.179146 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.179301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.179463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.179612 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.179767 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.179917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.180059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.180207 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.180358 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.180674 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.180914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.181070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.181070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.181450 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.181676 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.181676 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.182063 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.182237 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.182462 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.182678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.182678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.183030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.183266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.183266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.183668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.183891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.183891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.184324 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.184575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.184575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.185000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.185446 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.185446 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.185897 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.186112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.186481 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.186698 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.186909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.187138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.187387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.188530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.188884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.188884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.189384 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.189629 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.189629 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.190057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.190268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.190483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.190716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.191087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.191314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.191314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.191734 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.191943 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.192160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.195469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.195817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.196087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.196087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 31 13:38:16.198881 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.199257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.199257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.199722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.199950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.200194 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.200573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.200573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.201017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.201363 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.201363 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.201751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.201991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.201991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.202452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.202685 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.202909 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.203147 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.203147 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.203724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.204164 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.204164 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.204650 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.204914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.204914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.205339 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.205556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.205796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.206006 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.206006 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.206454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.206886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.206886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.207317 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.207545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.207772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.208015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.209005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.209606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.209606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210053 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210240 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210741 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.210889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.211171 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.211375 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.211751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.212001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.212240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.212679 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.212930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.213193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.213435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.213690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.213690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.214217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.214477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.214728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.214966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.215202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.215436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.215684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.215945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.216192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.216466 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.216731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.217161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.217377 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.217545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.217696 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.217846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.218034 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.218189 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.218422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.218422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.219436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.220103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.220400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.220665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.220922 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.221168 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.221168 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.221476 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.221627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.221914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.222193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.222193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.222546 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.222697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.222697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.223002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.223199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.223199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.223568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.224046 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.224046 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.224357 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.224538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.224699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.224699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.225115 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.225115 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.225566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.225802 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.228728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.229461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.229700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.229901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.232314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.232680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.232929 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.233189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.233446 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.233717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.233965 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.234227 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.234474 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.234474 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.235346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.236076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.236332 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.236651 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.236903 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.236903 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.237400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.237661 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.237924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.238111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.238111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.238432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.238692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.238692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.239275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.239660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.239660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.239971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.240135 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.240135 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.240458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.240855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.240855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.241171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.241340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.241497 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.241647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.241802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.242576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.242758 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.242926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243392 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243392 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.243853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.244135 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.244283 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.244455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.244630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.244788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.244938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.245086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.245235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.245235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.245539 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.245719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.245719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246169 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246473 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246622 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.246926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.247073 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.247073 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.247370 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.247517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.247517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.247875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248513 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248663 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.248821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.249261 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.249572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.249572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.250206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.250423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.250423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.250745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.250964 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.251214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.251458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.251458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.251863 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.252021 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.252021 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.252776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.252945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253269 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.253999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.254931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.255296 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.255445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.255603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.255603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.255886 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256685 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.256993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.257166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.257323 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.257480 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.257636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.257636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.258071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.258316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.258529 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.258693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.261647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.261829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.261987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.262138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.262328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.264198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.264474 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.264657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.264820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.264979 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.265141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.265298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.265456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.265627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.265862 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.266163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.266163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.266637 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.266637 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.267126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.267126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.267126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.267620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.267883 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.267883 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.268397 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.268644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.268876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.268876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.269510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.269510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.269893 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.270121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.270121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.270734 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.270981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.271213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.271869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.272113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.272634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.273087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.273345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.273763 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.273763 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.274371 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.274546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.274699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.274859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.274859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275591 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.275756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.276203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.276350 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.276563 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.276714 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.276870 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277019 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277019 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277901 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.277901 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.278190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.279348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.279348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.279348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.279796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.279946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.280094 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.280249 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.280451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.280834 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.281086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.281337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.281610 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.282360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.282632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.283064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.283513 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.283775 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.284009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.284221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.284470 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.284898 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.285129 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.285289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.285450 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.285609 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.285772 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286527 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.286974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.287121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.287276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.287425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.287572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.287572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.287875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.288025 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.288180 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.288489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.288489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.288796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.288796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.289089 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.289245 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.289394 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.289542 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.289699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.289848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.292547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.292798 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.293019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.294837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.295185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.295352 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.295516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.295676 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.295835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.296001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.296001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.296334 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.296664 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.296918 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.297137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.297412 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.297412 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.297833 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.298047 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.298291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.298564 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.298808 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.299022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.299241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.299456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.299736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.300014 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.300266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.300520 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.300773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301272 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301888 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.301888 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.302188 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.302188 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.302979 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.303148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.303327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.303592 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.303757 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.303907 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.304100 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.304300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.304633 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.304633 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.305459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.305849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306162 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.306981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.307140 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.307298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.307510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.307734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.307967 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120181) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.308176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.309805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.311588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.314307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.316048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.317279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.320866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.326230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.327809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.329590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.331002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.332141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.334003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.335252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.336755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.337980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.339120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.340267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.341432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.342541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.344328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.345947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.347438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.348695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.349847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.349847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.349847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.349847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.356364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.358288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.359511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.359511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.359511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.359511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.359511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.359511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.360963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.360963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.360963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.360963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.360963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.361791 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.361791 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.362076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.362345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.362668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.362997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.363318 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.363643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.363963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.364744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.365306 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.365661 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.366558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.367122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.367300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.367534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.367972 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.368408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.368728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.369060 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.369398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.369696 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.370019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.371577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.371577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.371577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.371577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.372273 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.372273 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.372694 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.373014 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.373359 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.373690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.374022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.374352 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.374670 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.375125 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.375309 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.375887 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.376938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.376938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.377655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.377655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.378029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.378584 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.379074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.379398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.380148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.380541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.380876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.381405 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.382764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.382764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.382764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.383429 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.383688 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.384215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.384834 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.385372 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.386206 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.388289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.388289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.388289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.389000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.389270 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.389829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.390376 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.390921 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.391478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.392015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.392828 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.393148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.393396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.393657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.396122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.399241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.400848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.400848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.400848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.400848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.400848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.402065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.402065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.402065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.402065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.403081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.405201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.405201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.405201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.405547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.406292 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.406292 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.406292 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.406727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.407080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.407404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.407731 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.408066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.408460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.408802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.409115 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.409433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.409873 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.410407 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.410933 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.411437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.412024 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.412603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.413000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_db.sqlalchemy.engines [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:16.413177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.413456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.413970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.414339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.414669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.414992 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.415315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.415645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.419766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.421152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.421152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.421152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.421152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.421565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.421773 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.422733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.422733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.423158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.423370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.427207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.428255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.429016 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.429314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.429916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.430559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.431747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.432233 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.432552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.432920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.433474 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.434056 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.434546 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.434875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.435196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.435522 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.435849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.436179 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.436541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.436886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.437225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.437565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.438234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.439846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.439846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.439846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.439846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 31 13:38:16.439846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120180) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 31 13:38:16.523146 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.context [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29c8b651-663d-4ed1-81b4-a3ed2cff61f0(cell1) {{(pid=120181) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 13:38:16.527909 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:16.529596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:16.530541 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:16.534699 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:16.545970 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_db.sqlalchemy.engines [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:16.546837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_db.sqlalchemy.engines [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:16.563383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_db.sqlalchemy.engines [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:16.654298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.context [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),29c8b651-663d-4ed1-81b4-a3ed2cff61f0(cell1) {{(pid=120180) load_cells /opt/stack/nova/nova/context.py:464}} Aug 31 13:38:16.659693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:16.661379 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:16.662293 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:16.666348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:16.679851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_db.sqlalchemy.engines [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:16.684732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_db.sqlalchemy.engines [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:16.840066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_db.sqlalchemy.engines [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120181) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:17.051245 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_db.sqlalchemy.engines [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120180) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 31 13:38:17.307285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: WARNING keystonemiddleware.auth_token [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:38:17.314360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: WARNING keystonemiddleware.auth_token [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:38:17.445339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: WARNING keystonemiddleware.auth_token [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:38:17.452593 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: WARNING keystonemiddleware.auth_token [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:38:17.672974 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: WARNING keystonemiddleware.auth_token [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:38:17.680981 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: WARNING keystonemiddleware.auth_token [None req-a436d9a8-455e-4105-be23-d8fab6fd26a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:38:17.686576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560eceb809c0 pid: 120181 (default app) Aug 31 13:38:17.850986 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: WARNING keystonemiddleware.auth_token [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 31 13:38:17.857418 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: WARNING keystonemiddleware.auth_token [None req-9a2289c9-d883-4cc3-b4b1-85beb6982be5 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 31 13:38:17.863549 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x560eceb809c0 pid: 120180 (default app) Aug 31 13:38:54.946781 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-142158820", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "7001dc11-bdb7-421c-bb7e-a8736e577820"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:38:56.158378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] validate_networks() for [('7001dc11-bdb7-421c-bb7e-a8736e577820', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:38:56.712386 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-78699041", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "fa07179d-dd48-41cb-8301-642273bf3aa6"}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:38:57.068188 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] validate_networks() for [('fa07179d-dd48-41cb-8301-642273bf3aa6', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:38:57.675232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:38:57.676514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:38:57.677322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:38:57.678024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:38:57.678665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:38:57.708689 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:57.720429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:57.721539 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:57.722164 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:57.792178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Getting quotas for project 0cc54c1c3c114f798454409802c69251. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:38:57.803555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Getting quotas for user 1038adde311f4067b4caeac07fc190bd and project 0cc54c1c3c114f798454409802c69251. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:38:57.821030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:38:57.825276 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:38:57.944434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c2938fd4-70a4-4a2a-b5e9-2b427aa1201f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.341262 Aug 31 13:38:57.945139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 1/1] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:38:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 4345 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:38:57.955004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5b146ec9-5e19-4f85-bc13-57924de8ca2d tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f58f9310>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:38:58.157850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5b146ec9-5e19-4f85-bc13-57924de8ca2d tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/4d58827c-536d-4774-b30c-10769f5eabdd" status: 200 len: 350 microversion: 2.1 time: 0.211301 Aug 31 13:38:58.158651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 2/2] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:38:57 2021] GET /compute/v2.1/os-volumes/4d58827c-536d-4774-b30c-10769f5eabdd => generated 350 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:38:58.164116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7b9d1ad3-cfe3-4ca3-96c7-a69e2fc67023 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:38:58.164884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7b9d1ad3-cfe3-4ca3-96c7-a69e2fc67023 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:38:58.399331 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7b9d1ad3-cfe3-4ca3-96c7-a69e2fc67023 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:38:58.444966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7b9d1ad3-cfe3-4ca3-96c7-a69e2fc67023 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1214 microversion: 2.1 time: 0.285167 Aug 31 13:38:58.459800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 3/3] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:38:58 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1214 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:38:58.531450 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:38:58.532981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:38:58.533995 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:38:58.534859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:38:58.535715 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:38:58.589713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:58.591271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:58.595601 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:38:58.598850 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:38:58.691142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:38:58.721704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for user cde9252205de47b2897144a70d230022 and project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:38:58.808652 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:38:58.824183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:38:59.106576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6527f1d3-a2ed-4968-ab48-071d0fbf3c3d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.980641 Aug 31 13:38:59.113733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 1/4] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:38:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 3987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:38:59.119612 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cbaf8a8a-456d-4984-ba92-ef0051bbcc6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:38:59.120231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cbaf8a8a-456d-4984-ba92-ef0051bbcc6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:38:59.469357 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e070ee9b-15ae-437c-8e00-0f93dd7e10ee tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:38:59.470307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e070ee9b-15ae-437c-8e00-0f93dd7e10ee tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:38:59.719186 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cbaf8a8a-456d-4984-ba92-ef0051bbcc6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:38:59.727057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cbaf8a8a-456d-4984-ba92-ef0051bbcc6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1216 microversion: 2.1 time: 0.611841 Aug 31 13:38:59.736740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 4/5] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:38:59 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1216 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:38:59.838487 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e070ee9b-15ae-437c-8e00-0f93dd7e10ee tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:38:59.867324 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e070ee9b-15ae-437c-8e00-0f93dd7e10ee tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1214 microversion: 2.1 time: 0.403451 Aug 31 13:38:59.883377 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 2/6] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:38:59 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1214 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:00.113842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f0e5624e-39db-4945-a00a-6fc70a9722c6 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f506a670>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:00.265575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f0e5624e-39db-4945-a00a-6fc70a9722c6 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/7c6ceb01-600f-4afc-829d-0ec0369547b9" status: 200 len: 351 microversion: 2.1 time: 0.170066 Aug 31 13:39:00.270389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 5/7] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:39:00 2021] GET /compute/v2.1/os-volumes/7c6ceb01-600f-4afc-829d-0ec0369547b9 => generated 351 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:39:00.750191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6524f024-2ddb-4717-822b-dd6efd27b3bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:00.754129 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6524f024-2ddb-4717-822b-dd6efd27b3bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:00.886962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:00.887765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:00.904750 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:00.907415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:00.910850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:00.912801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:01.001112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6524f024-2ddb-4717-822b-dd6efd27b3bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:01.011849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6524f024-2ddb-4717-822b-dd6efd27b3bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1216 microversion: 2.1 time: 0.269283 Aug 31 13:39:01.022611 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 3/8] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:00 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1216 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:01.490056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:01.521067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2e828053-8a89-4554-be35-bad330bdf9dc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1218 microversion: 2.1 time: 0.639225 Aug 31 13:39:01.522538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 6/9] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:00 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1218 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:02.039735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:02.040336 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:02.049226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:02.049770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:02.050835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:02.051433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:02.293404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-26309bc0-51b0-409a-a123-570c3b67d6b9 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4f96280>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:02.428790 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-26309bc0-51b0-409a-a123-570c3b67d6b9 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/5cbf471b-f30c-413d-be5d-6b98fea057df" status: 200 len: 351 microversion: 2.1 time: 0.141309 Aug 31 13:39:02.429954 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 7/10] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:39:02 2021] GET /compute/v2.1/os-volumes/5cbf471b-f30c-413d-be5d-6b98fea057df => generated 351 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:02.443578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2236066c-8045-4f42-a156-daaf39a5a7f7 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4fa8dc0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:02.475610 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:02.491325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a5ee1d05-4796-4a0b-b904-5637b191e542 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1212 microversion: 2.1 time: 0.456351 Aug 31 13:39:02.494535 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 4/11] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:02 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1212 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:02.543201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:02.545201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:02.557086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:02.557669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:02.559745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:02.561105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:02.593460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2236066c-8045-4f42-a156-daaf39a5a7f7 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.155741 Aug 31 13:39:02.595536 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 8/12] 10.222.0.21 () {58 vars in 1134 bytes} [Tue Aug 31 13:39:02 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:02.642508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-23f8d01a-b9b7-45e3-9b58-d15397c792f1 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4f96ee0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:03.017731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-23f8d01a-b9b7-45e3-9b58-d15397c792f1 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.386096 Aug 31 13:39:03.023173 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 9/13] 10.222.0.21 () {58 vars in 1149 bytes} [Tue Aug 31 13:39:02 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:03.036359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b2031179-c844-4e84-93dc-d372a9696769 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4fa8ca0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:03.180143 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b2031179-c844-4e84-93dc-d372a9696769 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.147779 Aug 31 13:39:03.191787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 10/14] 10.222.0.21 () {58 vars in 1134 bytes} [Tue Aug 31 13:39:03 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:03.197484 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fab4dabe-33db-4892-94ac-27092e30679c tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4fafdc0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:03.318009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:03.348664 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-da1b70a8-571b-4934-99b4-0b3cdfbf0885 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1272 microversion: 2.1 time: 0.813309 Aug 31 13:39:03.349276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 5/15] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:02 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1272 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:03.495045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fab4dabe-33db-4892-94ac-27092e30679c tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.301689 Aug 31 13:39:03.495641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 11/16] 10.222.0.21 () {58 vars in 1167 bytes} [Tue Aug 31 13:39:03 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:39:03.511209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-22833689-9c0a-4549-8b2d-de18bcd8ee0d tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f503d1f0>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:03.518252 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:03.519177 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:03.536343 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:03.536996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:03.549518 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:03.550103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:03.768131 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-22833689-9c0a-4549-8b2d-de18bcd8ee0d tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.261341 Aug 31 13:39:03.778241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 6/17] 10.222.0.21 () {58 vars in 1170 bytes} [Tue Aug 31 13:39:03 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:03.785289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d1add5b9-1245-4a19-95ad-e68fc4833448 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4fe71f0>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:03.955693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d1add5b9-1245-4a19-95ad-e68fc4833448 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.175393 Aug 31 13:39:03.957235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 7/18] 10.222.0.21 () {58 vars in 1155 bytes} [Tue Aug 31 13:39:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:03.969542 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-064454d6-8d67-4a54-a532-59542f139155 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4f53ee0>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:04.061034 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:04.092623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-49105169-6a9e-4234-b106-fe25b90da05a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1274 microversion: 2.1 time: 0.586929 Aug 31 13:39:04.094079 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 12/19] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:03 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1274 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:04.221486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-064454d6-8d67-4a54-a532-59542f139155 tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.256621 Aug 31 13:39:04.222677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 8/20] 10.222.0.21 () {58 vars in 1188 bytes} [Tue Aug 31 13:39:03 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:04.234555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a8b79d8d-ec2f-4659-9a48-408ec166104f tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] Calling method '.version_select at 0x7f67f4f96d30>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:04.367821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:04.368942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:04.381161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:04.390680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:04.391903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:04.393748 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:04.437136 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a8b79d8d-ec2f-4659-9a48-408ec166104f tempest-VolumesTestJSON-1755680847 tempest-VolumesTestJSON-1755680847-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.206825 Aug 31 13:39:04.451542 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 13/21] 10.222.0.21 () {58 vars in 1155 bytes} [Tue Aug 31 13:39:04 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:04.642995 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:04.662930 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-868caddd-2418-4c6b-961c-7da8387670ab tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1272 microversion: 2.1 time: 0.292512 Aug 31 13:39:04.665970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 9/22] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:04 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1272 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:05.121471 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:05.123786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:05.157561 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:05.158501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:05.161996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:05.165587 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:05.692030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:05.701380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:05.709894 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:05.710370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:05.715965 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:05.717232 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:05.762061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:05.778370 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7de19905-efb4-4066-8258-142e9160be9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1274 microversion: 2.1 time: 0.662988 Aug 31 13:39:05.785811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 14/23] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:05 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1274 bytes in 679 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:06.126065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:06.153738 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-84a1ef25-7f3f-4b22-98f4-0e58e355f855 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.465353 Aug 31 13:39:06.168783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 10/24] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:05 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:06.803846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:06.805435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:06.821130 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:06.822483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:06.823597 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:06.824278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:07.183778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:07.185140 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:07.215716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:07.216090 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:07.225178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:07.227119 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:08.171289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:08.190499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4553c491-dadb-4010-99ad-a06381ae2647 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1274 microversion: 2.1 time: 1.389281 Aug 31 13:39:08.193414 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 15/25] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:06 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1274 bytes in 1395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:08.495774 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:08.504433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9bc6519c-eb6f-4233-8556-27d8179e1341 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 1.329919 Aug 31 13:39:08.518515 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 11/26] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:07 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 1345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:09.211733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:09.212490 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:09.234733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:09.235280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:09.236111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:09.236680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:09.729032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1096549190", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3852d755-7c50-46df-80a0-1c0c41c9e729"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:09.894077 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] validate_networks() for [('3852d755-7c50-46df-80a0-1c0c41c9e729', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:39:10.928920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:10.948595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-bc5169b3-b4c5-4423-beec-9765195eb750 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 1.740930 Aug 31 13:39:10.960803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 12/27] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:09 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 1754 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:10.975821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:10.987310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:10.998985 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:10.999717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:11.001236 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:11.001823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:11.655561 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:11.673892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a8d54ec2-def6-403f-939e-fa6f521c7acc tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.711400 Aug 31 13:39:11.682565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 13/28] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:10 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:11.916103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-525c9bc6-f4e8-4d73-9340-459a04d1a33d req-c44469a8-e5d0-4212-bbf9-0bba4b267a98 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff5893af-a28f-49ab-b599-e85239bf3db4", "tag": "130e2381-2f69-40bb-8d34-e6b1d1aa9ab3"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:11.919676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:11.919676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:39:11.967367 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-525c9bc6-f4e8-4d73-9340-459a04d1a33d req-c44469a8-e5d0-4212-bbf9-0bba4b267a98 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:11.973116 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-525c9bc6-f4e8-4d73-9340-459a04d1a33d req-c44469a8-e5d0-4212-bbf9-0bba4b267a98 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:12.041976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-525c9bc6-f4e8-4d73-9340-459a04d1a33d req-c44469a8-e5d0-4212-bbf9-0bba4b267a98 service nova] Creating event network-changed:130e2381-2f69-40bb-8d34-e6b1d1aa9ab3 for instance ff5893af-a28f-49ab-b599-e85239bf3db4 on hv-cinder-80660 Aug 31 13:39:12.065597 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-525c9bc6-f4e8-4d73-9340-459a04d1a33d req-c44469a8-e5d0-4212-bbf9-0bba4b267a98 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120180) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 31 13:39:12.066696 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:12.067152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:12.068002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:12.068465 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:12.114743 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.compute.rpcapi [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 31 13:39:12.115748 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] Releasing lock "compute-rpcapi-router" {{(pid=120180) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 31 13:39:12.242252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-24bcd154-d5e9-47c0-be4b-2396b7308969 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.557589 Aug 31 13:39:12.247818 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 14/29] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:12.265603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:12.272298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:12.302177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:12.303019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:12.304136 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:12.304953 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:13.165389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:13.199874 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-46e86d2b-cf00-43d6-8ad3-b568a6741a41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.947132 Aug 31 13:39:13.204149 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 15/30] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:12 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:13.222413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:13.225276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:13.242688 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:13.243585 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:13.244810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:13.245559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:14.030479 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:14.065217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e8eb415b-6281-4cfa-8648-b203b5d49e48 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.850074 Aug 31 13:39:14.076569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 16/31] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:13 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:14.221980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:14.222753 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:14.233751 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:14.234393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:14.235433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:14.241560 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:14.877733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:14.886454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-417ee1c8-6691-4454-8f6d-73aeb758b287 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.668193 Aug 31 13:39:14.901191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 17/32] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:14 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:15.074973 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:39:15.075844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:39:15.077266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:39:15.077456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:39:15.078356 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:39:15.097666 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:15.098830 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:15.128720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:15.129178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:15.130115 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:15.130505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:15.148534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:15.149251 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:15.152208 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:15.156643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:15.157391 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Getting quotas for project ae54f8b2e084475ab699677246680a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:39:15.162286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Getting quotas for user 174b20d2ac0044439df2969dbc2ce325 and project ae54f8b2e084475ab699677246680a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:39:15.183603 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:39:15.185917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:39:15.345081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fa47fc67-fa3d-46d9-a139-51eb23eef884 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 6.341103 Aug 31 13:39:15.354199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 16/33] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:39:08 2021] POST /compute/v2.1/servers => generated 383 bytes in 6368 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:39:15.399449 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3a06f8e2-34ea-4200-8891-94be7fa36e81 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:15.400315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3a06f8e2-34ea-4200-8891-94be7fa36e81 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:15.957278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3a06f8e2-34ea-4200-8891-94be7fa36e81 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:15.994692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3a06f8e2-34ea-4200-8891-94be7fa36e81 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1222 microversion: 2.1 time: 0.638058 Aug 31 13:39:16.014568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 17/34] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:15 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1222 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:16.566050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cba4f612-947d-4675-b840-6638baf69003 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'create', calling method: .version_select at 0x7f67f5016dc0>, body: {"keypair": {"name": "tempest-keypair-2071530075"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:16.662950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:16.753678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f56ddfae-4c38-4b45-a212-e7b5e0798384 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 1.663573 Aug 31 13:39:16.760339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 18/35] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:15 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 1672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:16.798015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:16.802356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:16.829874 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:16.830314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:16.840472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cba4f612-947d-4675-b840-6638baf69003 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:39:16.844326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:16.844796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:16.852199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cba4f612-947d-4675-b840-6638baf69003 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for user efd51ea7f4e849538be43d6164cb1a30 and project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:39:17.718851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:17.730983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-949c84b4-9b0d-4477-9f30-c8c7a5e03a27 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.954177 Aug 31 13:39:17.737354 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 19/36] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:16 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:17.769872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1618858121", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3852d755-7c50-46df-80a0-1c0c41c9e729"}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:17.919638 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] validate_networks() for [('3852d755-7c50-46df-80a0-1c0c41c9e729', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:39:18.343214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cba4f612-947d-4675-b840-6638baf69003 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:39:18.349577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cba4f612-947d-4675-b840-6638baf69003 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for user efd51ea7f4e849538be43d6164cb1a30 and project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:39:18.372409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cba4f612-947d-4675-b840-6638baf69003 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2320 microversion: 2.20 time: 2.355173 Aug 31 13:39:18.392416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 18/37] 10.222.0.21 () {62 vars in 1199 bytes} [Tue Aug 31 13:39:16 2021] POST /compute/v2.1/os-keypairs => generated 2320 bytes in 2376 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:39:19.191193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-d40b8161-ed16-41c9-b456-8df30cf162b7 req-56340c31-a1fb-4501-bfe5-5bf2310b87b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d", "tag": "2a47da21-cc4f-45bc-938e-e78634de7de1"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:19.194235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:19.194235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:39:19.226340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d40b8161-ed16-41c9-b456-8df30cf162b7 req-56340c31-a1fb-4501-bfe5-5bf2310b87b2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.237154 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d40b8161-ed16-41c9-b456-8df30cf162b7 req-56340c31-a1fb-4501-bfe5-5bf2310b87b2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.271922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-d40b8161-ed16-41c9-b456-8df30cf162b7 req-56340c31-a1fb-4501-bfe5-5bf2310b87b2 service nova] Creating event network-changed:2a47da21-cc4f-45bc-938e-e78634de7de1 for instance b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d on hv-cinder-80660 Aug 31 13:39:19.273568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d40b8161-ed16-41c9-b456-8df30cf162b7 req-56340c31-a1fb-4501-bfe5-5bf2310b87b2 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120181) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 31 13:39:19.281105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.281903 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.283062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.283745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.307230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.compute.rpcapi [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] Automatically selected compute RPC version 6.0 from minimum service version 57 Aug 31 13:39:19.308590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] Releasing lock "compute-rpcapi-router" {{(pid=120181) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 31 13:39:19.373926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-71826bd1-6df3-44b7-b936-241505c2ec88 None None] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.979664 Aug 31 13:39:19.374594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 19/38] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 982 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:19.380910 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:19.384880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:19.394357 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.398295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.399639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.401461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.841903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:39:19.842972 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:39:19.844762 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:39:19.847552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:39:19.849179 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:39:19.900243 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.906829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.914014 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:19.916345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:19.975576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Getting quotas for project ae54f8b2e084475ab699677246680a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:39:19.986710 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Getting quotas for user 174b20d2ac0044439df2969dbc2ce325 and project ae54f8b2e084475ab699677246680a5e. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:39:20.022357 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:39:20.032935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:39:20.159788 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-74146942-d649-4a19-b545-0f65ee314c98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.421041 Aug 31 13:39:20.163990 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 20/39] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:39:17 2021] POST /compute/v2.1/servers => generated 383 bytes in 2426 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:39:20.185307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:20.186171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:20.196318 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:20.202983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:20.204850 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:20.206193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:20.683279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:20.752602 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-31c8ed84-86df-4da9-b04c-c8a541ff717f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 1.376158 Aug 31 13:39:20.754228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 20/40] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:19 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 1379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:20.769585 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7aa7c537-b173-482a-b194-c189c3ab3b0b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:20.771099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7aa7c537-b173-482a-b194-c189c3ab3b0b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:21.024503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7aa7c537-b173-482a-b194-c189c3ab3b0b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:21.050217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7aa7c537-b173-482a-b194-c189c3ab3b0b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1222 microversion: 2.1 time: 0.291747 Aug 31 13:39:21.053233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 21/41] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:20 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1222 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:21.114903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:21.123068 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2db393fe-41e5-4a21-8c30-c94723dbb52b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.957576 Aug 31 13:39:21.123759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 21/42] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:20 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 959 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:21.774857 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:21.775584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:21.792416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:21.793593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:21.798352 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:21.799075 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:22.073303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:22.074213 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:22.088683 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:22.089404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:22.114954 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:22.116451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:22.876025 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:22.942903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0455186c-6385-41c8-9014-13f81c0ff362 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1282 microversion: 2.1 time: 0.875442 Aug 31 13:39:22.946716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 22/43] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:22 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1282 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:22.955043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:22.958242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:22.977976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:22.979417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:22.981797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:22.996084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:23.336117 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:23.347279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-758bac06-b9e9-4d87-a679-98a406bb66da tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 1.579402 Aug 31 13:39:23.352574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 22/44] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:21 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 1585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:23.487320 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:23.495734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-30ba4a08-c8df-44bc-aff2-2188f7c0e231 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.547729 Aug 31 13:39:23.519103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 23/45] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:22 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:23.967721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:23.969171 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:24.008008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:24.008830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:24.019467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:24.020276 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:24.293512 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-d299d8f1-f632-4d8c-bfc1-f9db55d94c57 req-e353e116-67f7-4f80-a491-017a4af35318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15246791-5821-4746-ab57-de3340921964", "tag": "fb7a1805-78d8-4153-9f95-bc07f9da66f1"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:24.301905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:24.301905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:39:24.330937 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-d299d8f1-f632-4d8c-bfc1-f9db55d94c57 req-e353e116-67f7-4f80-a491-017a4af35318 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:24.331681 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-d299d8f1-f632-4d8c-bfc1-f9db55d94c57 req-e353e116-67f7-4f80-a491-017a4af35318 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:24.384551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-d299d8f1-f632-4d8c-bfc1-f9db55d94c57 req-e353e116-67f7-4f80-a491-017a4af35318 service nova] Creating event network-changed:fb7a1805-78d8-4153-9f95-bc07f9da66f1 for instance 15246791-5821-4746-ab57-de3340921964 on hv-cinder-80660 Aug 31 13:39:24.402711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-d299d8f1-f632-4d8c-bfc1-f9db55d94c57 req-e353e116-67f7-4f80-a491-017a4af35318 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115322 Aug 31 13:39:24.407280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 24/46] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:39:24.426921 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:24.432512 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:24.457059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:24.460644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:24.461731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:24.463841 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:24.467509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:24.476853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-15dac3f7-fbfa-4343-bd7c-fbba3403e532 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1280 microversion: 2.1 time: 0.512562 Aug 31 13:39:24.479006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 23/47] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:23 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1280 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:24.496692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1116838069", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2963958-fdd6-40d3-96f2-9d73522bf15e"}], "security_groups": [{"name": "tempest-securitygroup--118534628"}], "key_name": "tempest-keypair-2071530075", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:24.835221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] validate_networks() for [('e2963958-fdd6-40d3-96f2-9d73522bf15e', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:39:25.117279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:25.142885 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-08bac1ad-26a1-430f-b785-b9624fb3c32a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.731272 Aug 31 13:39:25.144054 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 25/48] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:24 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 736 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:25.171383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:25.175050 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:25.188786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:25.191155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:25.192199 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:25.193059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:25.624925 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:25.635070 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6437af7c-50a3-4309-91ba-4bdad84fcee1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.489212 Aug 31 13:39:25.639600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 26/49] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:25 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:25.659762 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:25.668517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:25.691347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:25.693329 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:25.696930 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:25.698206 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:26.485203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:26.515850 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2a79094f-91ce-4e66-9869-4fa7f8877e98 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.857134 Aug 31 13:39:26.517127 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 27/50] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:25 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:26.525896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:26.530558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:26.550423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:26.552606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:26.554609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:26.556259 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:26.651096 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:39:26.651997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:39:26.652945 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:39:26.653629 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:39:26.654248 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:39:26.667381 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:26.667986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:26.669275 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:26.670014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:26.693969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for project ed036eb1dc894a28af566c40419db15a. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:39:26.700638 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for user efd51ea7f4e849538be43d6164cb1a30 and project ed036eb1dc894a28af566c40419db15a. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:39:26.721054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:39:26.724742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:39:26.854513 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a04d94ad-ace3-4807-88a8-76e9f48341cb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 2.373935 Aug 31 13:39:26.860877 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 24/51] 10.222.0.21 () {62 vars in 1188 bytes} [Tue Aug 31 13:39:24 2021] POST /compute/v2.1/servers => generated 401 bytes in 2380 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 13:39:26.899620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:26.905066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:26.926505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:26.928467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:26.929787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:26.930529 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:27.268782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:27.318344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-65ea34a8-c21e-43f5-9459-7c4fcc383b08 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.795441 Aug 31 13:39:27.325452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 28/52] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:26 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 807 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:27.344786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e3fa9ba3-1074-4866-a3e6-20ed39296037 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:27.345419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e3fa9ba3-1074-4866-a3e6-20ed39296037 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:27.490393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e3fa9ba3-1074-4866-a3e6-20ed39296037 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:27.502936 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e3fa9ba3-1074-4866-a3e6-20ed39296037 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:27.508829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e3fa9ba3-1074-4866-a3e6-20ed39296037 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:27.512506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e3fa9ba3-1074-4866-a3e6-20ed39296037 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1282 microversion: 2.20 time: 0.184191 Aug 31 13:39:27.515038 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 29/53] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:27 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1282 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:27.542011 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:27.542659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:27.563438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:27.564016 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:27.570144 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:27.572277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:27.653715 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:27.674455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cbb9d8cc-9634-4253-bb97-fa847f20c520 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.812070 Aug 31 13:39:27.675685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 25/54] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:26 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 814 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:27.783977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-09dd3ad0-b672-4437-9691-f1cb324fc3ba req-85cc5ef6-e627-407c-a800-750e4e0de5ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "104c7902-81c4-4922-aa83-3e21a08ea7d6", "tag": "7a8c44df-bf04-44bd-9614-fe66dc1eea0d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:27.790830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:27.790830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:39:27.824267 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-09dd3ad0-b672-4437-9691-f1cb324fc3ba req-85cc5ef6-e627-407c-a800-750e4e0de5ea service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:27.826640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-09dd3ad0-b672-4437-9691-f1cb324fc3ba req-85cc5ef6-e627-407c-a800-750e4e0de5ea service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:27.854801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-09dd3ad0-b672-4437-9691-f1cb324fc3ba req-85cc5ef6-e627-407c-a800-750e4e0de5ea service nova] Creating event network-changed:7a8c44df-bf04-44bd-9614-fe66dc1eea0d for instance 104c7902-81c4-4922-aa83-3e21a08ea7d6 on hv-cinder-80660 Aug 31 13:39:27.870783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-09dd3ad0-b672-4437-9691-f1cb324fc3ba req-85cc5ef6-e627-407c-a800-750e4e0de5ea service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107733 Aug 31 13:39:27.875865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 26/55] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:27 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:27.932910 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:27.945918 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0cd87a84-bda8-468c-85d9-e6007df7fff7 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.410893 Aug 31 13:39:27.949852 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 30/56] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:27 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:28.340720 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:28.341700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:28.366626 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.367797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.369431 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.370393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.478835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-485dd635-2126-456c-b9d0-b9f0b3f1a218 req-5accb9c6-c531-4234-aa50-9dcdfc69ab28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5893af-a28f-49ab-b599-e85239bf3db4", "name": "network-vif-plugged", "status": "completed", "tag": "130e2381-2f69-40bb-8d34-e6b1d1aa9ab3"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:28.480490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:28.480490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:39:28.491101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-485dd635-2126-456c-b9d0-b9f0b3f1a218 req-5accb9c6-c531-4234-aa50-9dcdfc69ab28 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.491825 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-485dd635-2126-456c-b9d0-b9f0b3f1a218 req-5accb9c6-c531-4234-aa50-9dcdfc69ab28 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.504799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-485dd635-2126-456c-b9d0-b9f0b3f1a218 req-5accb9c6-c531-4234-aa50-9dcdfc69ab28 service nova] Creating event network-vif-plugged:130e2381-2f69-40bb-8d34-e6b1d1aa9ab3 for instance ff5893af-a28f-49ab-b599-e85239bf3db4 on hv-cinder-80660 Aug 31 13:39:28.518565 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-485dd635-2126-456c-b9d0-b9f0b3f1a218 req-5accb9c6-c531-4234-aa50-9dcdfc69ab28 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.359795 Aug 31 13:39:28.519224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 27/57] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:28.536006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:28.545020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:28.563802 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.565008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.566031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.573269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.783673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:28.796794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:28.803054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:28.806834 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bfab9bc5-5c76-43be-a774-f0920f49504a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1334 microversion: 2.20 time: 0.275623 Aug 31 13:39:28.811394 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 28/58] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:28 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1334 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:28.846256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:28.852305 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:28.863844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.866074 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.882000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:28.895137 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2bbf8197-26ab-4cdf-bdbe-d5f98e987996 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.558729 Aug 31 13:39:28.895496 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.898634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.919066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 31/59] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:28 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:28.974229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:28.975166 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:28.985637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.987765 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:28.990401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:28.991198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:29.241106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:29.251358 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-aeee0bb7-93a7-4bcf-a10a-164fc233b69e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.280579 Aug 31 13:39:29.262132 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 32/60] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:28 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:29.330358 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:29.345633 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4e2937bc-a4bf-4fe5-bedf-0256c64a85e4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.532020 Aug 31 13:39:29.347500 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 29/61] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:28 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:29.830939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:29.831873 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:29.841418 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:29.842734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:29.844049 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:29.844796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:29.923426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:29.928512 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:29.934688 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:29.935188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:29.936309 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:29.937377 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:29.964597 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:29.979871 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:29.982942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:29.984487 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9cec3e06-f02f-4f92-9d50-dbd5eb01a2e7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1340 microversion: 2.20 time: 0.158942 Aug 31 13:39:29.997579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 33/62] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:29 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1340 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:30.123782 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:30.133260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f126b448-33e9-462f-8243-1a61eb0fd453 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.214007 Aug 31 13:39:30.135294 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 30/63] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:29 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:30.276077 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:30.277739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:30.290879 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:30.292177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:30.296904 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:30.299461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:30.372425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:30.374599 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:30.396840 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:30.397585 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:30.398889 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:30.399513 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:30.534733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:30.549285 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b1b143b5-2c58-45eb-9efa-326084fb7054 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.281779 Aug 31 13:39:30.550893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 34/64] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:30 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:30.560300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-4f58390d-aa89-49f1-b047-cbb39fddafe5 req-7576cf80-20b4-4315-b2fa-4185b5dafbfe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d", "name": "network-vif-plugged", "status": "completed", "tag": "2a47da21-cc4f-45bc-938e-e78634de7de1"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:30.564256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:30.564256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:39:30.578427 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-4f58390d-aa89-49f1-b047-cbb39fddafe5 req-7576cf80-20b4-4315-b2fa-4185b5dafbfe service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:30.579632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-4f58390d-aa89-49f1-b047-cbb39fddafe5 req-7576cf80-20b4-4315-b2fa-4185b5dafbfe service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:30.610727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-4f58390d-aa89-49f1-b047-cbb39fddafe5 req-7576cf80-20b4-4315-b2fa-4185b5dafbfe service nova] Creating event network-vif-plugged:2a47da21-cc4f-45bc-938e-e78634de7de1 for instance b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d on hv-cinder-80660 Aug 31 13:39:30.625380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-4f58390d-aa89-49f1-b047-cbb39fddafe5 req-7576cf80-20b4-4315-b2fa-4185b5dafbfe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070854 Aug 31 13:39:30.627827 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 35/65] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:30 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:30.737001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:30.749500 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b7110ed3-5cb0-4d4f-904b-ecc94087a195 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.386210 Aug 31 13:39:30.751256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 31/66] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:30 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:31.013645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:31.015732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:31.037525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.038369 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.039543 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.040794 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.127005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:31.137462 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:31.139889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:31.142999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-375e1ae2-24a9-4d82-8b4e-feb1ff9f1367 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1340 microversion: 2.20 time: 0.137522 Aug 31 13:39:31.144244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 36/67] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:31 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1340 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:31.155392 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:31.158811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:31.171714 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.173452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.175039 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.176011 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.377654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:31.397054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2b40fe2e-1413-46b2-8c75-f651d530a858 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.249118 Aug 31 13:39:31.399000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 32/68] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:31 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:31.577498 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:31.578302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:31.586080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.587430 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.591389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.591389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.750868 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:31.758881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8a821c42-306e-4292-95c0-8f91c2cbe84b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.186986 Aug 31 13:39:31.759471 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 37/69] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:31 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:31.771490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:31.774497 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:31.782209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.782810 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:31.783693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:31.784201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:32.162813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:32.163465 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:32.174516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:32.174963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:32.175865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:32.197742 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:32.340950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:32.350396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:32.356955 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:32.366851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b67a387e-8d45-4fb5-8bbc-7b5d80090146 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1340 microversion: 2.20 time: 0.206970 Aug 31 13:39:32.368096 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 38/70] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:32 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1340 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:39:32.399787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:32.415238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:32.416098 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:32.417198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4552bbf8-4758-4897-9252-bef0cb763e10 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.653631 Aug 31 13:39:32.426054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 33/71] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:31 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 663 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:32.439692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:32.440131 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:32.441105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:32.441675 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:32.783090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:32.783720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:32.798524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:32.798969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:32.800209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:32.800822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:33.077699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:33.089917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6771e3a6-a35f-4c08-b46c-3dc26490d67d tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.678484 Aug 31 13:39:33.091536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 39/72] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:32 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:33.136940 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:33.147456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0e3fe9a2-019c-4741-b087-5752dec820ea tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.371003 Aug 31 13:39:33.148361 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 34/73] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:32 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:33.389267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:33.390332 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:33.401036 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:33.402057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:33.403152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:33.404066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:33.442563 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:33.446807 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:33.477329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:33.478214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:33.489813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:33.494724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:33.710740 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:33.726899 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:33.729931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:33.731786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0a3296dd-ba3b-4836-8c38-d95d8d4d4132 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.347201 Aug 31 13:39:33.739106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 40/74] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:33 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:33.761289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:33.774312 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3fbbd5ef-2bc4-47f9-9766-7d0778018acb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.341104 Aug 31 13:39:33.778567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 35/75] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:33 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:34.112926 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:34.113984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:34.123667 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.124525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.125923 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.126722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.166048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:34.167030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:34.173986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.174850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.176018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.176726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.341207 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:34.359320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b93d58dc-89fc-4098-bae4-166bbb85d17b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.197116 Aug 31 13:39:34.365071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 36/76] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:34 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:34.447071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:34.455497 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d0bb48ec-629c-4a9c-b928-87c990f081cd tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.346656 Aug 31 13:39:34.456158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 41/77] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:34 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:34.757534 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:34.759126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:34.767113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.767826 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.768648 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.769078 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.797987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:34.800187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:34.811604 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.812341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.813596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:34.814296 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:34.975586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:34.984680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:34.986808 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:34.988330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b51d8479-d43d-4bc0-b9e7-cc6395e3de27 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.238576 Aug 31 13:39:34.989569 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 37/78] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:34 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:35.081916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:35.092234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-27f0d87b-3982-475d-a181-0bfd0548020a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.300927 Aug 31 13:39:35.092967 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 42/79] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:34 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:35.384895 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:35.385831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:35.396136 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:35.396642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:35.397720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:35.398039 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:35.472641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:35.473354 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:35.481387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:35.481945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:35.483080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:35.483678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:35.603023 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:35.611868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7c8201c2-630c-4b28-9830-00b17ae0760f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.230826 Aug 31 13:39:35.612656 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 38/80] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:35 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:35.665567 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:35.673654 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f0f47ae1-63cf-4264-836b-0d43a33d0cd2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.204879 Aug 31 13:39:35.686557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 43/81] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:35 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:36.007167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:36.008627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:36.018280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.018826 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.019583 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.020012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.116218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:36.116218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:36.122139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.122746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.124795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.125343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.248713 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:36.262295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:36.265951 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:36.267742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-efdad82c-52f7-4f36-81ec-8a3b1d274bfb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.264368 Aug 31 13:39:36.268723 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 39/82] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:36 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:36.375721 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:36.395908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-324e0aab-1c4f-4209-b20c-982fbb58e0ca tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.288266 Aug 31 13:39:36.404009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 44/83] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:36 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:36.514658 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-ef43c2b7-2a28-4dc2-a47a-366eeb0fd1e1 req-23dff339-ff7c-4849-855a-b380df351f97 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15246791-5821-4746-ab57-de3340921964", "name": "network-vif-plugged", "status": "completed", "tag": "fb7a1805-78d8-4153-9f95-bc07f9da66f1"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:36.516067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:36.516067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:39:36.529371 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-ef43c2b7-2a28-4dc2-a47a-366eeb0fd1e1 req-23dff339-ff7c-4849-855a-b380df351f97 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.531513 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-ef43c2b7-2a28-4dc2-a47a-366eeb0fd1e1 req-23dff339-ff7c-4849-855a-b380df351f97 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.547671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-ef43c2b7-2a28-4dc2-a47a-366eeb0fd1e1 req-23dff339-ff7c-4849-855a-b380df351f97 service nova] Creating event network-vif-plugged:fb7a1805-78d8-4153-9f95-bc07f9da66f1 for instance 15246791-5821-4746-ab57-de3340921964 on hv-cinder-80660 Aug 31 13:39:36.554833 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-ef43c2b7-2a28-4dc2-a47a-366eeb0fd1e1 req-23dff339-ff7c-4849-855a-b380df351f97 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044525 Aug 31 13:39:36.556234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 40/84] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:39:36.635572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:36.637309 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:36.654569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.655325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.658153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.659348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.702634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:36.705931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:36.734108 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.740470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:36.744298 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:36.748344 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:37.109503 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:37.120773 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b13a2027-5b28-41e3-aeee-bc9718d11963 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.490414 Aug 31 13:39:37.131775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 45/85] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:36 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:37.304101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:37.307284 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:37.321665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:37.322137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:37.322636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:37.323258 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:37.323700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:37.345503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6523dbd3-72e6-4812-8a95-30bdbac7603a tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1314 microversion: 2.1 time: 0.655830 Aug 31 13:39:37.358256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 41/86] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:36 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1314 bytes in 671 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:37.422479 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:37.423865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:37.439071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:37.440667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:37.445589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:37.446516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:37.587624 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:37.599244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:37.601752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:37.619988 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-56addcb8-9164-4d8d-a7c5-89fb07e64982 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.333380 Aug 31 13:39:37.636161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 46/87] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:37 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:39:37.644230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-f8407e25-449d-4286-b692-0fb0ae25779f req-8bff9521-a00a-4684-aff8-b5ef259ca6e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:37.646420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:37.646420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:39:37.656122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f8407e25-449d-4286-b692-0fb0ae25779f req-8bff9521-a00a-4684-aff8-b5ef259ca6e6 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:37.656931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f8407e25-449d-4286-b692-0fb0ae25779f req-8bff9521-a00a-4684-aff8-b5ef259ca6e6 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:37.672776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-f8407e25-449d-4286-b692-0fb0ae25779f req-8bff9521-a00a-4684-aff8-b5ef259ca6e6 service nova] Creating event network-changed:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:39:37.678716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-f8407e25-449d-4286-b692-0fb0ae25779f req-8bff9521-a00a-4684-aff8-b5ef259ca6e6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040210 Aug 31 13:39:37.680348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 47/88] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:37.780150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:37.794291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b592b584-bea6-4bba-b00c-c400f41753f1 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1316 microversion: 2.1 time: 0.377183 Aug 31 13:39:37.813323 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 42/89] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:37 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1316 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:38.140438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:38.141277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:38.154056 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.154637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.156347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.156975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.366854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:38.367427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:38.384328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.385043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.386018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.387505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.462712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:38.475680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1641ce23-454c-4883-a890-da2398f0d4b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.339489 Aug 31 13:39:38.482960 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 48/90] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:38 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:38.640611 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:38.641411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:38.648688 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.656004 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.657245 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.657868 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.822279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:38.834016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-37204215-2448-4c3c-9473-c3fa8ef52968 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1501 microversion: 2.1 time: 0.472228 Aug 31 13:39:38.834814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 43/91] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:38 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1501 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:38.850061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:38.850061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:38.856464 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.856907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.858773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:38.859359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:38.933388 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:38.943441 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:38.944996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:38.946278 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-562ed2e7-8b9c-4c83-b658-e976fcf75ed2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.310498 Aug 31 13:39:38.947611 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 49/92] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:38 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:39.099897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:39.110402 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cfdf9c88-9d46-44d1-855a-8c6933297b9e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1506 microversion: 2.1 time: 0.274291 Aug 31 13:39:39.111379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 44/93] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:38 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1506 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:39.504215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:39.504215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:39.511643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:39.511882 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:39.513029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:39.513803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:39.747476 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:39.758162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0793d13e-8400-436a-8eb7-b5bd54aef70c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.259680 Aug 31 13:39:39.759067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 50/94] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:39 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:39.966930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:39.968452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:39.974596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:39.975338 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:39.976384 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:39.976901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:40.118026 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:40.127928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:40.129638 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:40.130920 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8befbb84-41d5-4a84-9237-79e0f5364bc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.167931 Aug 31 13:39:40.131509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 45/95] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:39 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:40.775816 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:40.776265 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:40.783142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:40.783590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:40.784517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:40.784951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:40.939125 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:40.954695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-40a3014d-9dfc-48ca-a23d-4943201c48ef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.182570 Aug 31 13:39:40.955988 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 51/96] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:40 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:41.150054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:41.150943 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:41.157401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:41.157855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:41.158672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:41.159067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:41.309929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:41.318939 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:41.320708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:41.322168 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cdd65a3a-ee68-4055-887e-ca96abaded4b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.175921 Aug 31 13:39:41.322772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 46/97] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:41 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:41.984588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:41.985959 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:41.994623 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:41.995277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:41.996253 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:41.997390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:42.236468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:42.244797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-197d2c1c-5f1e-42fd-9332-f974450f1809 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.265495 Aug 31 13:39:42.245707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 52/98] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:41 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:42.345871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:42.346499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:42.353486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:42.353976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:42.354828 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:42.355310 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:42.476738 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "14b8eb07-617b-4311-8cab-78914912a6b5"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:42.477855 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:42.488465 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:42.489028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:42.491571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:42.494891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:42.563164 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:42.577334 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:42.581537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:42.584558 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-78af1575-3157-42c8-9710-342af757182a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.244781 Aug 31 13:39:42.585632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 47/99] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:42 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:42.770006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3480dd01-4f3b-4972-9a2d-b512d1ca978b"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:42.771138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:42.777887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:42.778637 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:42.779398 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:42.780886 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:43.008914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6289141a-4ecb-49ea-89ea-efdc87a18ae6 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "POST /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.535790 Aug 31 13:39:43.016288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 53/100] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:39:42 2021] POST /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4/os-volume_attachments => generated 194 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:39:43.263438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:43.264163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:43.279162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:43.279788 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:43.280429 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:43.280884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:43.436002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:43.447446 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a91edcfc-b646-4419-85c8-d601d3a92a5d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.189442 Aug 31 13:39:43.448071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 54/101] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:43 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:43.606885 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:43.607732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:43.615259 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:43.615832 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:43.617729 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:43.618475 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:43.743498 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-71f04e2e-3c9b-43f7-8caf-28a0fe34e0eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.944022 Aug 31 13:39:43.743498 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 48/102] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:39:42 2021] POST /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments => generated 194 bytes in 977 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:39:43.778465 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-2b453c08-a522-40f3-93ed-4cb89be18f2d req-2887b2ba-554f-4cdc-9c20-7542d9dde5b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104c7902-81c4-4922-aa83-3e21a08ea7d6", "name": "network-vif-plugged", "status": "completed", "tag": "7a8c44df-bf04-44bd-9614-fe66dc1eea0d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:43.787851 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:43.787851 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:39:43.816105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-2b453c08-a522-40f3-93ed-4cb89be18f2d req-2887b2ba-554f-4cdc-9c20-7542d9dde5b4 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:43.817835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-2b453c08-a522-40f3-93ed-4cb89be18f2d req-2887b2ba-554f-4cdc-9c20-7542d9dde5b4 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:43.847673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-2b453c08-a522-40f3-93ed-4cb89be18f2d req-2887b2ba-554f-4cdc-9c20-7542d9dde5b4 service nova] Creating event network-vif-plugged:7a8c44df-bf04-44bd-9614-fe66dc1eea0d for instance 104c7902-81c4-4922-aa83-3e21a08ea7d6 on hv-cinder-80660 Aug 31 13:39:43.857252 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-2b453c08-a522-40f3-93ed-4cb89be18f2d req-2887b2ba-554f-4cdc-9c20-7542d9dde5b4 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112378 Aug 31 13:39:43.859017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 49/103] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:43 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:43.864234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:43.873939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:43.877208 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:43.878625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-73744906-164a-40d7-8dbd-04f9fba8fc57 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.277513 Aug 31 13:39:43.879431 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 55/104] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:43 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:44.470197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:44.471390 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:44.478868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:44.479795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:44.480803 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:44.481240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:44.702405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:44.708340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5217167a-a159-4ef4-b713-d82a6807ba7a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.245773 Aug 31 13:39:44.720980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 50/105] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:44 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:44.902018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:44.903735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:44.910449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:44.910892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:44.911669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:44.912105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:45.059174 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:45.073035 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:45.074634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:45.075888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e2ac8e81-3b79-4ef8-ad30-3e2ffd33fe68 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.178262 Aug 31 13:39:45.076817 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 56/106] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:44 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:45.733178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:45.735321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:45.760486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:45.760939 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:45.763328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:45.765392 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:45.947038 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:45.955749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-37a1a8ec-1d67-48bd-9345-7ef7c81fab33 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.228819 Aug 31 13:39:45.956157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 51/107] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:45 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:46.095262 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:46.095872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:46.102307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:46.102756 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:46.103544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:46.103946 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:46.265398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:46.274435 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:46.276407 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:46.277600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2b88651b-bdc6-4613-8df0-4b471a1dd74c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.186385 Aug 31 13:39:46.284522 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 57/108] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:46 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:46.972544 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:46.973604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:46.980559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:46.981000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:46.981813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:46.982238 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:47.121785 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:47.133485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c63457a2-1b30-43bd-8781-d9008e038ab4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.164348 Aug 31 13:39:47.134107 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 52/109] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:46 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:47.308668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:47.309468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:47.316671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:47.317248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:47.318078 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:47.318514 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:47.466646 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:47.476007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:47.477523 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:47.478609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-79ec26ed-928f-4720-955b-7390bd0c3e16 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.176378 Aug 31 13:39:47.479162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 58/110] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:47 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:48.152166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:48.153045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:48.161577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:48.162408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:48.163820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:48.164694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:48.333976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:48.345986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e3cae1e4-70bc-467f-be63-2cfeabc91989 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.197553 Aug 31 13:39:48.347037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 53/111] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:48 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:48.498406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:48.499451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:48.509722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:48.510419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:48.511352 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:48.512147 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:48.666407 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:48.675695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:48.677727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:48.679110 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3f8b30e3-b8f8-4b69-81f7-071ab0096a74 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.184614 Aug 31 13:39:48.679797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 59/112] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:48 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:49.363960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:49.364687 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:49.371316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:49.371766 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:49.372605 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:49.373037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:49.503236 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:49.511736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-db35b0c6-bd7c-42bd-b720-cddc5b8cc4da tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.151776 Aug 31 13:39:49.512287 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 54/113] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:49 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:49.699271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:49.699903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:49.707095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:49.707543 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:49.708310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:49.708771 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:49.837322 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:49.846262 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:49.847750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:49.849194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e18cd415-326d-4207-946f-ecdc30c523f2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.153588 Aug 31 13:39:49.849852 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 60/114] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:49 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:50.532812 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:50.533387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:50.540037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:50.540517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:50.541293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:50.541725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:50.681101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:50.693094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-857c99a9-e0ea-4c76-8328-8c17cb98d7d8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1322 microversion: 2.1 time: 0.166747 Aug 31 13:39:50.693993 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 55/115] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:50 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:50.867394 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:50.868141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:50.876403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:50.876885 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:50.877670 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:50.878101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:51.035082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:51.045389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:51.047935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:51.049248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ea009b46-ae84-4a6d-ba6b-6bec8229230c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.185716 Aug 31 13:39:51.049861 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 61/116] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:50 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:51.713328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:51.713857 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:51.720637 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:51.724726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:51.725681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:51.726286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:51.901796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:51.911600 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8c9e4376-162c-466e-b8fb-bd938a26a298 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1517 microversion: 2.1 time: 0.201939 Aug 31 13:39:51.912278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 56/117] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:51 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1517 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:51.929436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:51.930593 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:51.937349 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:51.938548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:51.939380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:51.939837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:51.964938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lazy-loading 'flavor' on Instance uuid 104c7902-81c4-4922-aa83-3e21a08ea7d6 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:39:52.072691 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:52.073293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:52.080625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:52.081302 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:52.082467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:52.083153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:52.091398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3a7c1821-e1f7-4412-bbe0-e460d8ec88b1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6/action" status: 200 len: 32 microversion: 2.1 time: 0.165783 Aug 31 13:39:52.092517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 62/118] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:39:51 2021] POST /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6/action => generated 32 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:39:52.103927 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:52.104468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:52.112170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:52.112847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:52.113493 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:52.113930 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:52.226556 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:52.234560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:52.236062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:52.237216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0805314f-b8e9-4282-8811-a2e980b96acf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.171938 Aug 31 13:39:52.237774 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 57/119] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:52 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:52.250223 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:52.258433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-066047a0-178d-4efc-8d87-9932baf8b700 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.159679 Aug 31 13:39:52.258997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 63/120] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:52 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:39:52.958773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-27e29dea-bb52-4821-95cd-b18201ae5f6f req-bc23f358-9113-40ee-9a13-b963db2f0914 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "name": "network-vif-plugged", "status": "completed", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:39:52.961791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:39:52.961791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:39:52.970621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-27e29dea-bb52-4821-95cd-b18201ae5f6f req-bc23f358-9113-40ee-9a13-b963db2f0914 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:52.971310 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-27e29dea-bb52-4821-95cd-b18201ae5f6f req-bc23f358-9113-40ee-9a13-b963db2f0914 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:52.987675 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-27e29dea-bb52-4821-95cd-b18201ae5f6f req-bc23f358-9113-40ee-9a13-b963db2f0914 service nova] Creating event network-vif-plugged:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:39:52.994654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-27e29dea-bb52-4821-95cd-b18201ae5f6f req-bc23f358-9113-40ee-9a13-b963db2f0914 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041951 Aug 31 13:39:52.995311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 58/121] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:39:52 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:39:53.256642 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:53.257204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:53.264976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:53.265466 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:53.266422 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:53.266727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:53.276989 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:53.277833 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:53.285627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:53.286163 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:53.286950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:53.287382 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:53.402322 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:53.410506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:53.412124 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:53.413257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-53e0bd8f-7068-4473-8495-4bcfb7fab051 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.160681 Aug 31 13:39:53.413816 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 64/122] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:53 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:53.422486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:53.431049 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cc547b82-fb05-4d9c-bdee-6bb7f56f4dcc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.158282 Aug 31 13:39:53.431754 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 59/123] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:53 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:54.434206 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:54.434786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:54.441754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:54.442200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:54.442956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:54.443492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:54.449796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:54.450469 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:54.457269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:54.457718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:54.458490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:54.458952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:54.575720 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:54.584415 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:54.585909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:54.587145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c1876948-cca1-4e39-83c1-11ca58f1c11d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.157405 Aug 31 13:39:54.587576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 65/124] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:54 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:54.589922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:54.598635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5b90da65-cc43-4cf3-91bf-d5c545a0b742 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.152428 Aug 31 13:39:54.599316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 60/125] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:54 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:55.604988 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:55.605581 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:55.611945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:55.612425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:55.613492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:55.613957 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:55.617991 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:55.619223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:55.625975 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:55.626753 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:55.627835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:55.628271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:55.770675 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:55.778679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-19136d9a-bcd9-486e-86c9-ce829a63bb39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.164380 Aug 31 13:39:55.779353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 61/126] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:55 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:55.782586 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:55.791815 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:55.793277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:55.794408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c94770b9-d457-4e27-af8c-4faff8d712bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.193216 Aug 31 13:39:55.794975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 66/127] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:55 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:56.796139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:56.796841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:56.803233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:56.803795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:56.806081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:56.806509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:56.815855 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:56.819087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:56.829244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:56.830039 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:56.830787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:56.831493 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:56.954475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:56.962887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ac4abbc0-6664-4dff-a507-cabcff40c957 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.170325 Aug 31 13:39:56.965655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:56.970742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 62/128] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:56 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:56.978085 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:56.979586 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:56.980713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ca90b1f3-911e-483c-9534-f3a0829f3e13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.171037 Aug 31 13:39:56.981283 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 67/129] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:56 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:39:57.979801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:57.980404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:57.987573 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:57.988154 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:57.989059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:57.989493 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:58.001332 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:58.002595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:58.009460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:58.009884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:58.010692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:58.011303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:58.129662 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:58.137887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-37bdf338-f95c-47d8-be23-67eb6b454a63 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.161869 Aug 31 13:39:58.138485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 63/130] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:57 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:58.146496 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:58.158141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:58.159664 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:58.160808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-183c6982-8672-4d7a-89dd-1b6c4163ea95 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.164978 Aug 31 13:39:58.161367 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 68/131] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:57 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:39:59.157860 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:59.158461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:59.165527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:59.166263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:59.167476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:59.168009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:59.182645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:39:59.183243 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:39:59.190241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:59.190688 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:59.191471 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:39:59.191903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:39:59.304472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:59.311977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-33f8f599-5eda-40d7-abb6-f909ea507074 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.157943 Aug 31 13:39:59.312758 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 64/132] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:39:59 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:39:59.321637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:59.329872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:59.331291 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:39:59.332423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-433369c6-10fe-4230-8b05-f6c4640920d1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.153715 Aug 31 13:39:59.333004 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 69/133] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:39:59 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:40:00.329942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:00.330548 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:00.338054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:00.338502 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:00.339409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:00.339907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:00.355018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:00.355655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:00.362773 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:00.363214 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:00.363998 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:00.364428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:00.482020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:00.493594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-82e822a5-7485-4e83-9527-9aa578e70c95 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.167610 Aug 31 13:40:00.494557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 65/134] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:00 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:00.498325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:00.507095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:00.508946 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:00.510053 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3e8ea255-f251-4c36-a8df-8052b8316582 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.159016 Aug 31 13:40:00.510622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 70/135] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:40:00 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:40:01.512400 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:01.513074 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:01.519585 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:01.520167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:01.520981 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:01.521405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:01.528542 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:01.529275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:01.536320 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:01.537458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:01.537577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:01.538040 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:01.664783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:01.674019 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-72c5a4cd-647c-4054-b777-9f0fc12e918c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.166276 Aug 31 13:40:01.674875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 66/136] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:01 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:01.682760 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:01.691970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:01.693618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:01.694759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-50535829-3103-4eea-823b-b79b3a5f9e0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1407 microversion: 2.20 time: 0.170579 Aug 31 13:40:01.695343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 71/137] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:40:01 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:40:02.691362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:02.691938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:02.698319 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:02.698753 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:02.699501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:02.699949 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:02.713349 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:02.713960 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:02.720353 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:02.720980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:02.721803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:02.722878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:02.859324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:02.868919 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-df884b8d-ebc3-4470-ab6c-65b43533bc92 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.180778 Aug 31 13:40:02.870902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 67/138] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:02 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:02.885903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:02.897155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:02.898556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:02.899801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-bbf59f25-337f-4779-a970-8a8fce71ee91 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1598 microversion: 2.20 time: 0.190339 Aug 31 13:40:02.901003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 72/139] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:40:02 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1598 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:40:02.918708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:02.919199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:02.933786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:02.934234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:02.935014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:02.935451 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:03.067839 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c2b2b8d7-31c1-4188-8cac-ac7397cc171a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.153034 Aug 31 13:40:03.068692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 68/140] 10.222.0.21 () {60 vars in 1316 bytes} [Tue Aug 31 13:40:02 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-interface => generated 284 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:40:03.890444 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:03.891073 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:03.901606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:03.903877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:03.905734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:03.906176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:03.990768 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:03.991304 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:03.997996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.000047 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.001136 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.001731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.040570 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:40:04.154620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e9758935-bcd8-4af5-bf0d-aa1fbb8309d3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 204 len: 0 microversion: 2.1 time: 0.169275 Aug 31 13:40:04.155599 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 69/141] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:40:03 2021] DELETE /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:40:04.165716 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:04.167786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:04.175730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.176502 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.177843 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.178421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.351136 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:04.365722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-38d58593-6a8b-409a-a48f-f53dbecbfaf9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.483478 Aug 31 13:40:04.366634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 73/142] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:03 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:04.433339 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:04.442230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-450f6585-8840-4812-8ff5-51490e79aad3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1553 microversion: 2.1 time: 0.281482 Aug 31 13:40:04.442843 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 70/143] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:04 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1553 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:04.833637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:04.834699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:04.838310 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-e3007668-e32b-485d-ac82-3f312041a380 req-c4b14bb1-0539-46fa-aac4-6f9a6936c7d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:04.840519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:04.840519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:04.842519 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.842971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.846927 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.848973 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.856142 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-e3007668-e32b-485d-ac82-3f312041a380 req-c4b14bb1-0539-46fa-aac4-6f9a6936c7d2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:04.857813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-e3007668-e32b-485d-ac82-3f312041a380 req-c4b14bb1-0539-46fa-aac4-6f9a6936c7d2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:04.878909 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-e3007668-e32b-485d-ac82-3f312041a380 req-c4b14bb1-0539-46fa-aac4-6f9a6936c7d2 service nova] Creating event network-changed:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:40:04.889337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-e3007668-e32b-485d-ac82-3f312041a380 req-c4b14bb1-0539-46fa-aac4-6f9a6936c7d2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055453 Aug 31 13:40:04.891203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 71/144] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:05.384993 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:05.385720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:05.393619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:05.394883 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:05.396362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:05.397293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:05.604814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:05.613595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-13b89447-79bf-41e6-9dd4-00934b14caa6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.233785 Aug 31 13:40:05.615359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 72/145] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:05 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:05.621440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:05.622254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:05.629533 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:05.630066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:05.631085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:05.631731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:05.779101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:05.787271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fe0efea7-77a7-48a3-bcb4-97933946203f tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1553 microversion: 2.1 time: 0.170334 Aug 31 13:40:05.787871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 73/146] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:05 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:06.632400 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:06.633335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:06.639235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:06.639685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:06.640474 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:06.640901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:06.771856 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:06.779535 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-07abba68-b151-4b73-b96b-eb0a82b1a2cf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.150764 Aug 31 13:40:06.780126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 74/147] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:06 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:06.804519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:06.805170 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:06.811556 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:06.812010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:06.812825 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:06.813240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:06.960779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:06.968817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b2240833-187f-4478-b89d-5b2f314e1250 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1553 microversion: 2.1 time: 0.168053 Aug 31 13:40:06.969353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 75/148] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:06 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:07.244649 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-aa66a848-9fbc-4529-95a2-6eaf30282464 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 2.415055 Aug 31 13:40:07.245751 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 74/149] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:04 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 2417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:07.799024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:07.799673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:07.806247 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:07.807178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:07.808192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:07.808979 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:07.948931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:07.956635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0c7a8373-2ac8-4a0b-8bb6-636967936cf0 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.161903 Aug 31 13:40:07.957204 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 76/150] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:07 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:07.986434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:07.987216 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:07.993941 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:07.994384 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:07.995162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:07.995584 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:08.129869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:08.138535 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d09c16bf-0258-4959-be71-c8a16f200726 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1553 microversion: 2.1 time: 0.156193 Aug 31 13:40:08.139108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 75/151] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:07 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:08.255632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:08.257882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:08.269006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:08.270786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:08.272589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:08.273189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:08.365230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cdedea08-b141-45a4-8d77-3b3ad4706bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.113269 Aug 31 13:40:08.365882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 77/152] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:08 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:08.974462 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:08.975810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:08.984958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:08.985594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:08.986712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:08.987294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:09.126120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:09.134549 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-70f4368b-0d6b-4e6c-8995-7d21281eb9b5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.163872 Aug 31 13:40:09.135153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 76/153] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:08 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:09.156846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:09.157608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:09.164630 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:09.165196 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:09.166300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:09.166730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:09.309406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:09.316875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1bb05209-b936-41f4-8083-d902d06c6042 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1553 microversion: 2.1 time: 0.164264 Aug 31 13:40:09.317455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 78/154] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:09 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1553 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:09.377221 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:09.378333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:09.385117 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:09.385736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:09.387226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:09.387686 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:09.465636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fabb220c-b2d2-40ce-a9d1-e70e0ea65b60 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.091943 Aug 31 13:40:09.469431 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 77/155] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:09 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:10.151880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:10.152534 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:10.160859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.162053 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.163080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.163998 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.329118 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:10.335644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:10.336463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:10.347218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.347676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.348875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.349315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.349510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9b83bf42-0697-4966-bc42-abf204870edc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.201605 Aug 31 13:40:10.359845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 79/156] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:10 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:10.450509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:10.460907 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0cb2138a-d162-422c-a7a1-fa1d76f66db3 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1511 microversion: 2.1 time: 0.130014 Aug 31 13:40:10.461502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 78/157] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:10 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1511 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:10.461626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-24d9a8cf-2f92-4ce9-b464-cfefdde68504 req-80f1226a-b477-483b-bb4e-618b1203d2d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff5893af-a28f-49ab-b599-e85239bf3db4", "name": "network-vif-deleted", "tag": "130e2381-2f69-40bb-8d34-e6b1d1aa9ab3"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:10.463348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:10.463348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:10.470575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-24d9a8cf-2f92-4ce9-b464-cfefdde68504 req-80f1226a-b477-483b-bb4e-618b1203d2d9 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.471133 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-24d9a8cf-2f92-4ce9-b464-cfefdde68504 req-80f1226a-b477-483b-bb4e-618b1203d2d9 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.477385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:10.478306 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:10.483330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-24d9a8cf-2f92-4ce9-b464-cfefdde68504 req-80f1226a-b477-483b-bb4e-618b1203d2d9 service nova] Creating event network-vif-deleted:130e2381-2f69-40bb-8d34-e6b1d1aa9ab3 for instance ff5893af-a28f-49ab-b599-e85239bf3db4 on hv-cinder-80660 Aug 31 13:40:10.485551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.485993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.487296 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:10.488015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:10.490304 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-24d9a8cf-2f92-4ce9-b464-cfefdde68504 req-80f1226a-b477-483b-bb4e-618b1203d2d9 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030746 Aug 31 13:40:10.494868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 80/158] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:40:10.592248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-30c5af0a-a74a-40f5-9392-115c66c9813a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.119476 Aug 31 13:40:10.593081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 79/159] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:10 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:11.370243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:11.371002 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:11.392394 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:11.392917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:11.393715 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:11.394288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:11.480180 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:11.481082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:11.489062 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:11.489798 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:11.490619 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:11.491072 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:11.525428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:11.534160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c8a99104-2df0-469a-9aa0-75ea2ba32c54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.170758 Aug 31 13:40:11.535003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 81/160] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:11 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:11.561931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:11.574381 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c7f1d478-2643-4cf5-b4d3-27d678c93c07 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1345 microversion: 2.1 time: 0.098204 Aug 31 13:40:11.575122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 80/161] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:11 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:11.604230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:11.605481 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:11.611736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:11.612209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:11.614662 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:11.615069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:12.551006 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:12.551646 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:12.558314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:12.558768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:12.559548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:12.559983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:12.694943 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:12.703046 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ad3ea338-1ea7-4408-8294-a2bdb8cd36ce tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.155715 Aug 31 13:40:12.703634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 81/162] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:12 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:12.708906 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:12.709514 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:12.716225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:12.716731 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:12.717536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:12.718320 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:12.784007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:12.792276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5c48f54f-e1c8-4067-b161-e1a486269ceb tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1345 microversion: 2.1 time: 0.087237 Aug 31 13:40:12.792856 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 82/163] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:12 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1345 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:13.544120 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-653119e6-f661-4b30-9eac-aa6df2f45652 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 1.943763 Aug 31 13:40:13.545212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 82/164] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:11 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 1946 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:13.721906 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:13.722502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:13.728952 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:13.729395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:13.730172 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:13.730566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:13.814804 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:13.815646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:13.823936 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:13.824799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:13.825626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:13.826064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:13.873256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:13.882137 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6cf93cb7-5c95-42cf-9540-3456b11cb488 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.163895 Aug 31 13:40:13.883488 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 83/165] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:13 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:13.899809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:13.908640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7d988a5b-b867-4f30-ba9e-d232a073d950 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1345 microversion: 2.1 time: 0.098265 Aug 31 13:40:13.909266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 83/166] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:13 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1345 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:14.558607 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:14.559642 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:14.568604 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:14.569211 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:14.569995 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:14.570430 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:14.651542 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-880b28a1-82a2-4ca3-aedf-54f7ed458b84 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.098538 Aug 31 13:40:14.655317 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 84/167] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:14 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:14.901776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:14.902532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:14.911984 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:14.912765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:14.914007 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:14.914889 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:14.928829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:14.930411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:14.949361 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:14.950649 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:14.951698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:14.952500 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:15.053632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:15.055403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:15.056583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lazy-loading 'fault' on Instance uuid ff5893af-a28f-49ab-b599-e85239bf3db4 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:40:15.186495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1038adde311f4067b4caeac07fc190bd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0cc54c1c3c114f798454409802c69251', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:15.202564 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2c132aa8-feea-4cf8-bba1-9119743179c2 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 200 len: 1304 microversion: 2.1 time: 0.279676 Aug 31 13:40:15.204173 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 85/168] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:14 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 1304 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:15.288272 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:15.305813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5bdd632d-0083-4efd-9788-2362f022d9e8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.408648 Aug 31 13:40:15.306635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 84/169] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:14 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:15.663426 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:15.664715 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:15.672060 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:15.672871 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:15.674486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:15.675223 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:15.693669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-28511552", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "fa07179d-dd48-41cb-8301-642273bf3aa6"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:15.766156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] validate_networks() for [('fa07179d-dd48-41cb-8301-642273bf3aa6', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:40:15.790302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-69d0fdc4-6bf8-430a-b488-2dee4457f2b0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.130082 Aug 31 13:40:15.791314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 86/170] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:15 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:16.204843 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:40:16.205645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:40:16.206322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:40:16.206797 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:40:16.207343 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:40:16.221519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.222080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.224227 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.224806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.227746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:16.230529 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:16.240693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.241198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.242106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.242675 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.250957 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:16.258808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] HTTP exception thrown: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. Aug 31 13:40:16.259375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for user cde9252205de47b2897144a70d230022 and project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:16.259501 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Returning 404 to user: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:40:16.260982 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-047bc24f-0168-4a88-8111-829c9bee0471 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 404 len: 111 microversion: 2.1 time: 0.041295 Aug 31 13:40:16.261606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 87/171] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:16 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:40:16.277349 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:40:16.281035 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:40:16.326297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:16.327114 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:16.333537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-91525c43-144c-4e39-804d-16c6a6a104f2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643946 Aug 31 13:40:16.335192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 85/172] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:40:15 2021] POST /compute/v2.1/servers => generated 380 bytes in 646 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:40:16.348507 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2584e1f6-af7b-4cb9-bfc2-ada35b724dfe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:16.349360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2584e1f6-af7b-4cb9-bfc2-ada35b724dfe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:16.351939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.353342 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.358643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.361149 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.443614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2584e1f6-af7b-4cb9-bfc2-ada35b724dfe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:16.458038 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2584e1f6-af7b-4cb9-bfc2-ada35b724dfe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1216 microversion: 2.1 time: 0.116183 Aug 31 13:40:16.479013 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 86/173] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:16 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1216 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:16.485730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:16.486739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:16.496127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.496611 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.497616 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.498193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.520329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] HTTP exception thrown: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. Aug 31 13:40:16.521003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Returning 404 to user: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:40:16.522014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cbae76d3-c501-48a8-b609-48b59f9385f7 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.041601 Aug 31 13:40:16.531145 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 87/174] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:40:16 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4/os-volume_attachments => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:40:16.597590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:16.610391 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-07bb2c5a-fa48-4629-95da-14a660754911 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.287788 Aug 31 13:40:16.611888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 88/175] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:16 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:16.806740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:16.810295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:16.853387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.853724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:16.876003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:16.882155 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:17.067100 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-05e8e7cb-6770-49b4-bf25-cef39e4e78e3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.266237 Aug 31 13:40:17.068831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 88/176] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:16 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:17.481035 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:17.483385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:17.496062 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:17.496882 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:17.498456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:17.499563 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:17.598286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:17.606205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-60ce8095-d9bf-4b58-b1af-29c831ac9718 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1268 microversion: 2.1 time: 0.133324 Aug 31 13:40:17.606728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 89/177] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:17 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1268 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:17.637391 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:17.639017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:17.648440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:17.649363 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:17.650472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:17.650871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:17.793326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:17.802009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-56df4f85-62ac-4406-98df-aac2e9824e4f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.172542 Aug 31 13:40:17.802982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 89/178] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:17 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:18.079550 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:18.080494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:18.088413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.088942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.089782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.090210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.201064 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fe602662-c34d-4e42-beb4-addaeee5cf86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.121123 Aug 31 13:40:18.205178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 90/179] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:18 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:18.211602 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:18.212122 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:18.218385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.219045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.220101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.220729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.236907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] HTTP exception thrown: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. Aug 31 13:40:18.237804 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Returning 404 to user: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:40:18.238815 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f2e5462e-0f98-4939-b060-90be96f5560e tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 404 len: 111 microversion: 2.1 time: 0.031236 Aug 31 13:40:18.250035 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:18.251109 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] [instance: ff5893af-a28f-49ab-b599-e85239bf3db4] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:18.254950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 90/180] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:40:18 2021] DELETE /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:40:18.260735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.261898 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.262878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.263540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.282398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] HTTP exception thrown: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. Aug 31 13:40:18.283299 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] Returning 404 to user: Instance ff5893af-a28f-49ab-b599-e85239bf3db4 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:40:18.284495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5dc2a73c-60aa-4451-8fab-c26d27461699 tempest-DeleteServersTestJSON-1940253044 tempest-DeleteServersTestJSON-1940253044-project] 10.222.0.21 "GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4" status: 404 len: 111 microversion: 2.1 time: 0.040368 Aug 31 13:40:18.285122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 91/181] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:18 2021] GET /compute/v2.1/servers/ff5893af-a28f-49ab-b599-e85239bf3db4 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:40:18.624317 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:18.624981 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:18.637666 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.640004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.640958 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.641409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.720514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:18.730642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-06d607e1-8567-46e7-aceb-bbfcea9912c2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1274 microversion: 2.1 time: 0.109795 Aug 31 13:40:18.731582 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 91/182] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:18 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1274 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:18.820401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:18.821746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:18.828126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.828897 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:18.829855 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:18.830257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:19.197183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:19.207598 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ad318a84-327a-4422-b5a0-5ea4e319c50c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.390624 Aug 31 13:40:19.208907 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 92/183] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:18 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:19.221908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:19.222817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:19.233977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:19.234415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:19.235208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:19.235629 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:19.313786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7ceead0a-12fd-450e-8c5b-c8b540c5e3e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 14 microversion: 2.20 time: 0.104478 Aug 31 13:40:19.317405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 92/184] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:19 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 14 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:19.749578 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:19.750444 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:19.763182 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:19.763641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:19.764488 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:19.768341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:20.033228 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:20.049217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e10d30c0-dfbd-485e-ab58-e0d752b83f68 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1316 microversion: 2.1 time: 0.302408 Aug 31 13:40:20.065521 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 93/185] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:19 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1316 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:20.225020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:20.225715 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:20.236652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:20.237634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:20.239185 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:20.239851 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:20.329698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:20.334283 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:20.351139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:20.353592 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:20.361603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:20.364671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:20.458849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fd75591a-7c4b-4d7c-bebd-dcf20acd9fd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 1586 microversion: 2.20 time: 0.137058 Aug 31 13:40:20.464774 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 94/186] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:20 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 1586 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:40:20.675434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:20.685479 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-90a4d1da-83c5-41d5-88b7-22f28ded4264 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.464312 Aug 31 13:40:20.686247 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 93/187] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:20 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:20.792159 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-90269db7-c032-4cd6-891f-de1f01574ce3 req-4de02a26-5910-4ed6-9723-474197ccf87b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3cfc754c-3286-4482-8113-5e72cc0aeb76", "tag": "70fec9ce-85f9-4426-b600-045a974f93bb"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:20.795971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:20.795971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:40:20.812966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-90269db7-c032-4cd6-891f-de1f01574ce3 req-4de02a26-5910-4ed6-9723-474197ccf87b service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:20.813441 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-90269db7-c032-4cd6-891f-de1f01574ce3 req-4de02a26-5910-4ed6-9723-474197ccf87b service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:20.838553 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-90269db7-c032-4cd6-891f-de1f01574ce3 req-4de02a26-5910-4ed6-9723-474197ccf87b service nova] Creating event network-changed:70fec9ce-85f9-4426-b600-045a974f93bb for instance 3cfc754c-3286-4482-8113-5e72cc0aeb76 on hv-cinder-80660 Aug 31 13:40:20.844093 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-90269db7-c032-4cd6-891f-de1f01574ce3 req-4de02a26-5910-4ed6-9723-474197ccf87b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059420 Aug 31 13:40:20.845687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 95/188] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:21.074538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:21.075626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:21.086521 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:21.089647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:21.091097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:21.091922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:21.234786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:21.243643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e4eb74cd-34df-4634-b09d-a4a066b3b7aa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1316 microversion: 2.1 time: 0.173476 Aug 31 13:40:21.244217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 94/189] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:21 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1316 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:21.475104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:21.477324 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:21.494435 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:21.496977 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:21.498107 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:21.498808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:21.615507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b0228923-c6eb-4e18-88d6-d26ac6943f0e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 10658 microversion: 2.20 time: 0.145677 Aug 31 13:40:21.616570 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 96/190] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:21 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 10658 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:21.704506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:21.706652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:21.717185 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:21.718422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:21.719448 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:21.720590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:21.902659 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:21.912190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-485eae05-65a4-4c12-bcb8-4d83d179042d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.211643 Aug 31 13:40:21.913816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 95/191] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:21 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:22.263182 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:22.263908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:22.274794 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:22.275288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:22.276129 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:22.276598 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:22.483556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:22.491439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-96c16ce7-befd-40a9-a201-dd8a4b188852 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1316 microversion: 2.1 time: 0.232718 Aug 31 13:40:22.493857 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 97/192] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:22 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1316 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:22.637141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:22.638205 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:22.650045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:22.650579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:22.651453 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:22.651891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:22.817684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fb93feaf-5360-4b96-b467-03ae92da9d7a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 15025 microversion: 2.20 time: 0.193955 Aug 31 13:40:22.818662 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 96/193] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:22 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 15025 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:22.931962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:22.933472 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:22.944316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:22.948550 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:22.949708 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:22.952266 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:23.192908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:23.202718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6850b6a9-3c3f-4010-bb50-649cda014986 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.274554 Aug 31 13:40:23.203895 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 98/194] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:22 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:23.516735 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:23.521876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:23.543094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:23.543853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:23.544742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:23.545198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:23.830234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:23.831207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:23.846942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:23.850146 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:23.851133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:23.851572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:23.874010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:23.892823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-50a7891d-e8ba-45d1-a1c3-675fe024b37d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1316 microversion: 2.1 time: 0.380494 Aug 31 13:40:23.898929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 97/195] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:23 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:23.960033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fcffdd1f-b476-4b4c-a896-7804a9962c37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 17861 microversion: 2.20 time: 0.133195 Aug 31 13:40:23.964036 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 99/196] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:23 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 17861 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:24.219338 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:24.220260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:24.230459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:24.231574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:24.232482 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:24.232928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:24.750635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:24.760484 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c551180e-880f-4cee-9c35-3cee3aa844fe tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.544818 Aug 31 13:40:24.770770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 98/197] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:24 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:24.914254 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:24.916026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:24.925025 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:24.932775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:24.934717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:24.936337 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:24.978224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:24.979153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:24.998837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:24.999674 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:25.000685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:25.001301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:25.114444 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-77097cae-9802-47e5-9003-790d18a97ebd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 17861 microversion: 2.20 time: 0.145819 Aug 31 13:40:25.116197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 99/198] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:24 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 17861 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:25.311786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-a173c878-447b-4024-bbbd-a84e44050773 req-e1fba3d6-896c-491c-a9ef-fc9ba222eea2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfc754c-3286-4482-8113-5e72cc0aeb76", "name": "network-vif-plugged", "status": "completed", "tag": "70fec9ce-85f9-4426-b600-045a974f93bb"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:25.313387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:25.313387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:25.323911 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-a173c878-447b-4024-bbbd-a84e44050773 req-e1fba3d6-896c-491c-a9ef-fc9ba222eea2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:25.324386 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-a173c878-447b-4024-bbbd-a84e44050773 req-e1fba3d6-896c-491c-a9ef-fc9ba222eea2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:25.353405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-a173c878-447b-4024-bbbd-a84e44050773 req-e1fba3d6-896c-491c-a9ef-fc9ba222eea2 service nova] Creating event network-vif-plugged:70fec9ce-85f9-4426-b600-045a974f93bb for instance 3cfc754c-3286-4482-8113-5e72cc0aeb76 on hv-cinder-80660 Aug 31 13:40:25.359359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-a173c878-447b-4024-bbbd-a84e44050773 req-e1fba3d6-896c-491c-a9ef-fc9ba222eea2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052919 Aug 31 13:40:25.368931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 100/199] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:25 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:40:25.763741 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:25.781217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-275bef4c-df63-4674-a97a-db6e4412d490 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1316 microversion: 2.1 time: 0.871519 Aug 31 13:40:25.782077 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:25.782253 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 100/200] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:24 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1316 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:25.783258 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:25.790282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:25.790773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:25.791556 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:25.791996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:26.129568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:26.130490 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:26.139123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:26.139574 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:26.140352 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:26.140848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:26.211568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:26.221486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-070a1a70-e94e-4208-8e1e-bf9bde3204f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.446025 Aug 31 13:40:26.222141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 101/201] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:25 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:26.502693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8ddbc8be-5441-4cea-838f-b0b5a4470a51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 19342 microversion: 2.20 time: 0.378561 Aug 31 13:40:26.503459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 101/202] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:26 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 19342 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:26.799230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:26.800527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:26.809345 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:26.809788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:26.811509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:26.811953 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:27.027121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:27.039301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b643591d-cfb3-426c-9fc0-b713f343a6df tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1316 microversion: 2.1 time: 0.243522 Aug 31 13:40:27.054859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 102/203] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:26 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1316 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:27.243836 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:27.245191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:27.260151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:27.261086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:27.262845 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:27.263531 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:27.518559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:27.521564 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:27.530472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:27.531356 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:27.532960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:27.533804 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:27.643717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-08e3f19e-d3a4-40ef-87c0-5bba543eb8ef tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 20148 microversion: 2.20 time: 0.131769 Aug 31 13:40:27.647663 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 103/204] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:27 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 20148 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:27.676170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:27.686401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a2805239-67e2-4e41-a43d-7cb34fdf3357 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1523 microversion: 2.1 time: 0.450360 Aug 31 13:40:27.696713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 102/205] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:27 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1523 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:28.063335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:28.064801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:28.074636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.075337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.076529 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.077258 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.227493 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:28.244740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9a56ee2e-45bc-461b-be54-259656376398 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1506 microversion: 2.1 time: 0.180347 Aug 31 13:40:28.249070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 104/206] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:28 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1506 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:28.256545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3480dd01-4f3b-4972-9a2d-b512d1ca978b"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:28.258107 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:28.264922 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.265363 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.266319 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.267368 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.410637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] HTTP exception thrown: Invalid volume: volume 3480dd01-4f3b-4972-9a2d-b512d1ca978b is already attached to instances: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d Aug 31 13:40:28.411634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Returning 400 to user: Invalid volume: volume 3480dd01-4f3b-4972-9a2d-b512d1ca978b is already attached to instances: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:40:28.412637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9972aa20-b455-4c6d-bb67-9d4365f6223b tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.160686 Aug 31 13:40:28.413732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 103/207] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:40:28 2021] POST /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76/os-volume_attachments => generated 174 bytes in 162 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:40:28.494181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:28.494453 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:28.508819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.509286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.528415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.529004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.655578 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:28.657734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:28.675112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.675534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.676331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.676787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.777871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'services' on Instance uuid b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:40:28.809408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-38d3a2e0-8965-460b-9870-e43e68d9f2f4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 21834 microversion: 2.20 time: 0.157357 Aug 31 13:40:28.810048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 104/208] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:28 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 21834 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:28.815113 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1815733277", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "8ee43288-e7ed-4568-96cb-42de300ea126"}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:28.918114 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] validate_networks() for [('8ee43288-e7ed-4568-96cb-42de300ea126', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:40:28.937711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f5c13e61-e049-4117-9f4d-7a468911dbe0 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments/3480dd01-4f3b-4972-9a2d-b512d1ca978b" status: 202 len: 0 microversion: 2.1 time: 0.448006 Aug 31 13:40:28.938665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 105/209] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:40:28 2021] DELETE /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments/3480dd01-4f3b-4972-9a2d-b512d1ca978b => generated 0 bytes in 452 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:28.949555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:28.950274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:28.967683 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.973483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:28.975088 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:28.976143 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.635761 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:29.647850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-07c33af5-0353-47dc-bce8-0c202543c465 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1503 microversion: 2.1 time: 0.703759 Aug 31 13:40:29.648526 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 106/210] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:28 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1503 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:29.655257 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:29.656967 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:29.665070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.666076 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.667429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.668301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.712768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:40:29.713791 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:40:29.714411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:40:29.715004 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:40:29.715408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:40:29.728416 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.730645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.737779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-50fe8f8e-fe79-4110-8d6a-f4c10df9d5e2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.087563 Aug 31 13:40:29.739116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 107/211] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:40:29 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments => generated 197 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:29.743708 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.748254 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.751004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:29.752526 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:29.762681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.763176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.763960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.766078 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.807430 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Getting quotas for project c037b436492542b99cf63627ac6af982. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:29.821372 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Getting quotas for user fbb73d40aa804f87aa1bf30a98ee35c7 and project c037b436492542b99cf63627ac6af982. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:29.865807 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:40:29.868738 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:40:29.960243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:29.968849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-45782ce0-e6cf-464a-98ed-90eea1863f26 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1517 microversion: 2.1 time: 0.228342 Aug 31 13:40:29.970079 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 108/212] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:29 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1517 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:29.975249 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:29.976457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:29.981468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-637d9920-64c6-41e0-a106-92359accbd29 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.169624 Aug 31 13:40:29.983387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 105/213] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:40:28 2021] POST /compute/v2.1/servers => generated 380 bytes in 1173 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:40:29.991278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.992554 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:29.998431 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:29.999072 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:30.003990 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cd25a996-1905-421a-aa0b-7b31ab6b1f2c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:30.007316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cd25a996-1905-421a-aa0b-7b31ab6b1f2c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:30.134550 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1182b1f4-158e-4da9-83d8-ccf33234c0e1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 22994 microversion: 2.20 time: 0.160708 Aug 31 13:40:30.135519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 109/214] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:29 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 22994 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:30.180508 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cd25a996-1905-421a-aa0b-7b31ab6b1f2c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:30.189755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cd25a996-1905-421a-aa0b-7b31ab6b1f2c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1214 microversion: 2.1 time: 0.195394 Aug 31 13:40:30.203650 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 106/215] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:29 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1214 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:30.750460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:30.751777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:30.766353 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:30.766907 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:30.767797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:30.768450 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:30.817736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-51b11184-5606-4fa2-9012-e323ecb8de28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070443 Aug 31 13:40:30.818980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 107/216] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:40:30 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:40:30.893562 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-588ee656-63c2-4cdb-b338-f504d8c42b30 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: .version_select at 0x7f67f45e1f70>, body: {"keypair": {"name": "tempest-keypair-933173224"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:30.923890 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-588ee656-63c2-4cdb-b338-f504d8c42b30 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:30.929522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-588ee656-63c2-4cdb-b338-f504d8c42b30 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for user aaf0bbd19382494aa7e4c3dc4cb976d9 and project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:31.123579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1317901682", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "fa07179d-dd48-41cb-8301-642273bf3aa6"}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:31.230078 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-588ee656-63c2-4cdb-b338-f504d8c42b30 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:31.234534 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-588ee656-63c2-4cdb-b338-f504d8c42b30 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for user aaf0bbd19382494aa7e4c3dc4cb976d9 and project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:31.250737 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-588ee656-63c2-4cdb-b338-f504d8c42b30 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2304 microversion: 2.1 time: 0.653257 Aug 31 13:40:31.252062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 110/217] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 31 13:40:30 2021] POST /compute/v2.1/os-keypairs => generated 2304 bytes in 655 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:31.258198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:31.259146 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:31.268012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:31.268482 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:31.269319 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:31.270106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:31.286369 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] validate_networks() for [('fa07179d-dd48-41cb-8301-642273bf3aa6', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:40:31.381173 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-afa4aac4-ed08-48b7-a42e-33e4343d07ae tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 23794 microversion: 2.20 time: 0.126872 Aug 31 13:40:31.383372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 111/218] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:31 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 23794 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:31.388946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:31.389815 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:31.398073 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:31.399042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:31.403175 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:31.403859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:31.530010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:31.541867 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-95b8dc6c-b479-4532-ae8e-15233285ee8b tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1266 microversion: 2.1 time: 0.157156 Aug 31 13:40:31.552653 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 112/219] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:31 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:31.947729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:31.948912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:31.964225 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:31.979318 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:31.980169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:31.983001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.038938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lazy-loading 'flavor' on Instance uuid 15246791-5821-4746-ab57-de3340921964 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:40:32.057347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:40:32.058009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:40:32.058690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:40:32.059423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:40:32.060155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:40:32.086808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.087804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.089778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.090382 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.132013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:32.145984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for user cde9252205de47b2897144a70d230022 and project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:32.187313 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:40:32.205871 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:40:32.292172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7803ec41-fe2a-4fcd-a645-59ffeeb4135c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action" status: 200 len: 32 microversion: 2.1 time: 0.359707 Aug 31 13:40:32.293671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 113/220] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:40:31 2021] POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:40:32.298534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-14338b56-e031-4824-9e87-88f0638f5fc3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.193401 Aug 31 13:40:32.307819 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 108/221] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:40:31 2021] POST /compute/v2.1/servers => generated 380 bytes in 1204 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:40:32.310472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:32.311923 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:32.322568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-304ccbd6-c193-4575-8549-ab7e0a6c90b3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:32.324724 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-304ccbd6-c193-4575-8549-ab7e0a6c90b3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:32.327709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.336582 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.355125 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.356817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.593339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-304ccbd6-c193-4575-8549-ab7e0a6c90b3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:32.626754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-304ccbd6-c193-4575-8549-ab7e0a6c90b3 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1218 microversion: 2.1 time: 0.311182 Aug 31 13:40:32.628857 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 109/222] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:32 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1218 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:32.641768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:32.642843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:32.661344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.662240 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.663144 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.663609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.820987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:32.835445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d27ba83d-ac48-4c11-9e95-4d7b11917807 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.531041 Aug 31 13:40:32.836178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 114/223] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:32 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:32.845957 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:32.847390 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:32.861486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.861938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.862801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:32.863239 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:32.963599 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:32.971367 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a24211da-e975-4934-a2f3-6af8e35366dd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1272 microversion: 2.1 time: 0.133863 Aug 31 13:40:32.971978 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 115/224] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:32 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1272 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:33.650595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:33.652315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:33.659567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:33.660013 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:33.661059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:33.661643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:33.762647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:33.779840 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8a7c7f3e-2a6d-401e-8b38-daba68345ddb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1222 microversion: 2.1 time: 0.124830 Aug 31 13:40:33.780564 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 116/225] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:33 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1222 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:33.831318 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-427428422", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ac58f34-a341-48d5-804c-8e4590340424"}], "security_groups": [{"name": "tempest-securitygroup--345507961"}], "key_name": "tempest-keypair-933173224", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:33.949121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] validate_networks() for [('9ac58f34-a341-48d5-804c-8e4590340424', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:40:34.646108 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:40:34.647470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:40:34.648153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:40:34.649372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:40:34.650051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:40:34.667363 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:34.668216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:34.669219 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:34.669819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:34.693367 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:34.698960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for user aaf0bbd19382494aa7e4c3dc4cb976d9 and project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:34.710970 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:40:34.714040 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:40:34.780105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e410aa3b-1640-4156-b9b9-f9e3556bdd35 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.955462 Aug 31 13:40:34.781344 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 117/226] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:40:33 2021] POST /compute/v2.1/servers => generated 401 bytes in 958 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:40:34.786488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:34.787389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:34.796793 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:34.797520 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:34.798628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:34.799208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:35.092217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:35.100191 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-55b39c89-3dbb-4dd2-ab86-cd35992ab4f6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.317650 Aug 31 13:40:35.111325 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 118/227] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:34 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:35.116647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:35.117589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:35.127153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:35.127601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:35.128401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:35.130758 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:35.234271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ad8b85b3-b046-47b3-b98c-ffe53d02db79 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 25669 microversion: 2.20 time: 2.599793 Aug 31 13:40:35.239365 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 110/228] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:32 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 25669 bytes in 2610 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:35.248247 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-47927876-443e-4adf-8fc6-d6b33e5d5599 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:35.250458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-47927876-443e-4adf-8fc6-d6b33e5d5599 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:35.359989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-47927876-443e-4adf-8fc6-d6b33e5d5599 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:35.367063 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-47927876-443e-4adf-8fc6-d6b33e5d5599 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1236 microversion: 2.1 time: 0.125966 Aug 31 13:40:35.367854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 111/229] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:35 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1236 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:35.372247 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:35.372864 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:35.381787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:35.382878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:35.384725 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:35.385175 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:35.567452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:35.579608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f1b97df4-280b-495d-a525-c008e21601f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.466777 Aug 31 13:40:35.580479 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 119/230] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:35 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 468 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:35.596666 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:35.606792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ad82b0f4-bed5-41e4-9c19-be3244b2ce53 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1214 microversion: 2.1 time: 0.237813 Aug 31 13:40:35.607389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 112/231] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:35 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1214 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:36.120659 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:36.122140 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:36.131520 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.132135 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.133959 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.134671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.253806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:36.255336 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:36.272203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.273758 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.276649 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.277330 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.413719 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:36.422945 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-78984d38-b374-451c-848d-537763f86490 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.308921 Aug 31 13:40:36.426811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 120/232] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:36 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:36.439222 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-32d7da6d-23e9-4e07-8627-e563e66453e3 req-4a7863b1-c107-49ec-88ff-a6ef45dbdef1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3d15babf-70c0-4706-9266-567d649aca84", "tag": "472e99bf-8ad9-4b67-ab61-3811882ef14a"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:36.442575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:36.442575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:36.457790 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5a7a9c9a-dcd7-4273-a404-ed034e898c90 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 26345 microversion: 2.20 time: 0.213363 Aug 31 13:40:36.459202 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 113/233] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:36 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 26345 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:36.465559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:36.471562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:36.476483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-32d7da6d-23e9-4e07-8627-e563e66453e3 req-4a7863b1-c107-49ec-88ff-a6ef45dbdef1 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.477736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-32d7da6d-23e9-4e07-8627-e563e66453e3 req-4a7863b1-c107-49ec-88ff-a6ef45dbdef1 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.490465 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-32d7da6d-23e9-4e07-8627-e563e66453e3 req-4a7863b1-c107-49ec-88ff-a6ef45dbdef1 service nova] Creating event network-changed:472e99bf-8ad9-4b67-ab61-3811882ef14a for instance 3d15babf-70c0-4706-9266-567d649aca84 on hv-cinder-80660 Aug 31 13:40:36.496340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-32d7da6d-23e9-4e07-8627-e563e66453e3 req-4a7863b1-c107-49ec-88ff-a6ef45dbdef1 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067703 Aug 31 13:40:36.497306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 121/234] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:36 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:36.499575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.500125 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.502831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.503310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.598045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:36.598820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:36.600987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:36.619906 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ca265bb9-8630-4541-8e32-342c24eee06c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1288 microversion: 2.1 time: 0.158272 Aug 31 13:40:36.621033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.621509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 114/235] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:36 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1288 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:36.623022 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.624035 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.624542 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.633461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:36.636618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:36.655995 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.656489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.659170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:36.659935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:36.770988 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:36.783934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-38c8f339-3c7d-4d72-906a-e374cd7dc51e tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1276 microversion: 2.1 time: 0.159975 Aug 31 13:40:36.795911 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 115/236] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:36 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1276 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:36.914000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:36.924752 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b3b7c4cd-a938-4168-8ba1-7d0127a178e0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.330665 Aug 31 13:40:36.935295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 122/237] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:36 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:37.443608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:37.444181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:37.455153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.455600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.456674 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.457109 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.471627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:37.472684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:37.490066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.492342 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.494744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.499362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.619016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9099d2ad-6d5f-4573-bce8-7db4546d3f80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 26906 microversion: 2.20 time: 0.151371 Aug 31 13:40:37.622820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 123/238] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:37 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 26906 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:37.642829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:37.643882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:37.656902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.657836 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.659160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.659751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.765710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:37.773822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d3c1e8b4-45f4-4a1e-b182-ab59fa7d808c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1294 microversion: 2.1 time: 0.137957 Aug 31 13:40:37.774800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 124/239] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:37 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1294 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:37.779876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:37.788232 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-24ed0ea4-3030-48ea-9784-04ca9a8738d5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.348233 Aug 31 13:40:37.788961 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 116/240] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:37 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:37.803211 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:37.803832 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:37.811579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.811929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.813020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.813448 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.943473 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:37.950777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:37.962048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.975924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:37.977306 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:37.977964 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.028153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:38.040156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8e0c2502-eccd-4509-bba1-1c399650be41 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.237961 Aug 31 13:40:38.049199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 125/241] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:37 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:38.362048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:38.372219 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-00a7d86e-1d39-45b3-98b2-31b9c7f1d7fd tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.432667 Aug 31 13:40:38.381861 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 117/242] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:37 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:38.630971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:38.632959 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:38.640851 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:38.641476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.642403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:38.642992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.740596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f1d2c6f8-253c-4afa-9281-33c0e8b7d24b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 27262 microversion: 2.20 time: 0.113277 Aug 31 13:40:38.742237 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 126/243] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:38 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 27262 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:38.791818 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:38.792542 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:38.798594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:38.799279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.805085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:38.806366 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:38.810410 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:38.810879 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.813695 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:38.814346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.815291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:38.815729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:38.967516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:38.977155 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f1235d18-a6d3-442f-ae2b-ead52e58d4d1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.176199 Aug 31 13:40:38.978183 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 127/244] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:38 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:39.055092 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:39.055696 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:39.062435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.062905 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.063731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.064161 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.193234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:39.201574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-27872c87-5d6a-41fa-8893-5f43620965af tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.150247 Aug 31 13:40:39.210776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 128/245] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:39 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:39.259841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-d53667e0-c7c2-4a30-8c1b-feb9efdc428b req-62dd0d89-515c-4a51-b745-41ba2748b563 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c7d383ef-a49f-4b9f-92f9-71b4b0493d96", "tag": "98e342d6-9a45-48b2-9686-3c8ca491c352"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:39.261940 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:39.261940 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:39.288725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d53667e0-c7c2-4a30-8c1b-feb9efdc428b req-62dd0d89-515c-4a51-b745-41ba2748b563 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.289389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d53667e0-c7c2-4a30-8c1b-feb9efdc428b req-62dd0d89-515c-4a51-b745-41ba2748b563 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.326250 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-d53667e0-c7c2-4a30-8c1b-feb9efdc428b req-62dd0d89-515c-4a51-b745-41ba2748b563 service nova] Creating event network-changed:98e342d6-9a45-48b2-9686-3c8ca491c352 for instance c7d383ef-a49f-4b9f-92f9-71b4b0493d96 on hv-cinder-80660 Aug 31 13:40:39.332103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-d53667e0-c7c2-4a30-8c1b-feb9efdc428b req-62dd0d89-515c-4a51-b745-41ba2748b563 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078178 Aug 31 13:40:39.333208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 129/246] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:39 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:39.390739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:39.391722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:39.396095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:39.405093 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-80fed899-ac28-4b9b-8577-b9aa68d5d063 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.617567 Aug 31 13:40:39.405804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 118/247] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:38 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:39.418685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.419133 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.419883 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.420560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.574555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:39.581903 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-df84218b-bf11-4af1-bb05-27ddea4a0ac1 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.195640 Aug 31 13:40:39.582475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 130/248] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:39 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:39.753183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:39.754365 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:39.762854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.763665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.764609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:39.765039 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:39.876280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b76ce843-7a6e-4b8c-a664-bde872f7ff66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 27679 microversion: 2.20 time: 0.126593 Aug 31 13:40:39.879517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 119/249] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:39 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 27679 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:40.009610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:40.012088 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:40.027110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.028362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.040983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.040983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.218680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:40.225516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:40.226494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:40.229379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2f922b43-32ba-4089-aae7-4a8231ee243e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.237543 Aug 31 13:40:40.238703 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.239145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.240078 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 131/250] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:39 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:40.245030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.245400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.422200 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:40.422803 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:40.434394 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.435015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.437282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.438020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.656515 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:40.663921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:40.664509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-575df2d3-41c5-452a-851a-3f64cd0ad431 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.448734 Aug 31 13:40:40.672037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-350061e3-7d7c-4ccb-835d-f4353f25ded4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.254120 Aug 31 13:40:40.678804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 120/251] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:40 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:40.682791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 132/252] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:40 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:40.692438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:40.697264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:40.705037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.705983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.707126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.708218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.902176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:40.903069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:40.909427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.910079 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:40.910996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:40.911553 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.010852 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:41.018449 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-862864c3-9ee6-4dfc-a6dd-f85167d46c6c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 27889 microversion: 2.20 time: 0.130193 Aug 31 13:40:41.019340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 133/253] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:40 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 27889 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:41.022399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e04b6076-1ce8-470b-81ee-3b4cc6b2beb2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.341267 Aug 31 13:40:41.023189 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 121/254] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:40 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:41.251896 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:41.253318 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:41.261253 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.262546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.263874 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.264759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.380283 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-0a2d6cd8-b147-4b62-8aba-8d456ed6e024 req-97cc82bb-9070-4402-8831-d14d0d747baf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600915c4-ecf3-4004-8c57-260a462152a7", "tag": "abeb489f-0045-481c-8ee8-424a975cb388"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:41.382100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:41.382100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:40:41.391385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-0a2d6cd8-b147-4b62-8aba-8d456ed6e024 req-97cc82bb-9070-4402-8831-d14d0d747baf service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.392067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-0a2d6cd8-b147-4b62-8aba-8d456ed6e024 req-97cc82bb-9070-4402-8831-d14d0d747baf service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.407004 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-0a2d6cd8-b147-4b62-8aba-8d456ed6e024 req-97cc82bb-9070-4402-8831-d14d0d747baf service nova] Creating event network-changed:abeb489f-0045-481c-8ee8-424a975cb388 for instance 600915c4-ecf3-4004-8c57-260a462152a7 on hv-cinder-80660 Aug 31 13:40:41.412264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-0a2d6cd8-b147-4b62-8aba-8d456ed6e024 req-97cc82bb-9070-4402-8831-d14d0d747baf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036044 Aug 31 13:40:41.414352 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 122/255] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:41 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:40:41.421094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:41.428594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b900eebd-332e-4b06-bcf3-9e11bf5f2338 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.180887 Aug 31 13:40:41.430110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 134/256] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:41 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:41.686889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:41.688401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:41.698020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:41.698568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.698950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:41.699099 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.699853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.700288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.712187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.712187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.713308 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:41.714095 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:41.982206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:41.992999 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5b31a873-7d16-4427-88b0-d402c7c5a0c5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.307574 Aug 31 13:40:41.993916 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 135/257] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:41 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:42.031524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:42.034385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:42.049324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:42.055477 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:42.058841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:42.059489 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:42.162295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-41f18b76-c02a-4b78-92c7-f79524880977 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28116 microversion: 2.20 time: 0.135294 Aug 31 13:40:42.162908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 136/258] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:42 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28116 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:42.171639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:42.172430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:42.183988 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:42.184972 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:42.186282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:42.186994 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:42.330156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:42.339123 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-44ce8e14-f278-4e48-9d60-c48076b8836d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.174421 Aug 31 13:40:42.339806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 137/259] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:42 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:42.446839 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:42.447811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:42.454172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:42.454925 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:42.455908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:42.456582 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:42.472612 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:42.480779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ea747fbc-a1ec-42aa-8337-4203c7bf911f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.800062 Aug 31 13:40:42.481364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 123/260] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:41 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 802 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:42.604042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:42.612418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-84245c90-b637-4fac-8f15-72c2a8a2513b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.169159 Aug 31 13:40:42.613071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 138/261] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:42 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:43.010783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:43.011374 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:43.017779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.018221 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.018984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.019405 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.152875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:43.160713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c1127824-1e41-4aa5-aa61-6330f8cf3e38 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.153908 Aug 31 13:40:43.161338 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 124/262] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:43 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:43.176433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:43.177409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:43.184181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.184666 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.185413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.185829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.357506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:43.358108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:43.365528 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.366255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.367529 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.368417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.512966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:43.521759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ed91d751-b0e7-43e6-97a0-dc130d764824 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.169093 Aug 31 13:40:43.522891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 125/263] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:43 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:43.528459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:43.529454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:43.535152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.535574 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.536423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.536859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.679140 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:43.689731 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-bafc5549-ec3f-4c0d-9003-83acbab0b5a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.165181 Aug 31 13:40:43.690460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 126/264] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:43 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:43.694983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:43.695629 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:43.702621 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.703333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.704276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:43.704893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:43.842511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:43.852683 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-115a4057-1754-49b8-a535-4af8f00be739 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.160977 Aug 31 13:40:43.853807 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 127/265] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:43 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:44.178942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:44.179547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:44.187251 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.187915 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.188962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.189467 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.338897 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:44.346821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e53bf90e-faf4-4878-bbf6-b5e4c7097fdf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.171540 Aug 31 13:40:44.347396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 128/266] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:44 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:44.540167 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:44.541055 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:44.547657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.548283 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.548836 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.549238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.679895 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:44.687896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cbe1ba30-d986-49d1-9673-86b5fdfae451 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.151713 Aug 31 13:40:44.688532 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 129/267] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:44 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:44.692931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-fafdb845-d5d2-407a-b577-3e49573c879b req-624da9e3-0bc3-4a23-850c-050b14d2fc6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d15babf-70c0-4706-9266-567d649aca84", "name": "network-vif-plugged", "status": "completed", "tag": "472e99bf-8ad9-4b67-ab61-3811882ef14a"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:44.694495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:44.694495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:40:44.706894 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-fafdb845-d5d2-407a-b577-3e49573c879b req-624da9e3-0bc3-4a23-850c-050b14d2fc6b service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.707366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-fafdb845-d5d2-407a-b577-3e49573c879b req-624da9e3-0bc3-4a23-850c-050b14d2fc6b service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.719161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-fafdb845-d5d2-407a-b577-3e49573c879b req-624da9e3-0bc3-4a23-850c-050b14d2fc6b service nova] Creating event network-vif-plugged:472e99bf-8ad9-4b67-ab61-3811882ef14a for instance 3d15babf-70c0-4706-9266-567d649aca84 on hv-cinder-80660 Aug 31 13:40:44.724275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-fafdb845-d5d2-407a-b577-3e49573c879b req-624da9e3-0bc3-4a23-850c-050b14d2fc6b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034616 Aug 31 13:40:44.724898 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 130/268] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:44.730513 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:44.731210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:44.738138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.738579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.739360 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.739773 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.872341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:44.883509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5d32d2c2-31c0-4326-a1cb-a60d8c56af9f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.157398 Aug 31 13:40:44.884194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 131/269] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:44 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:44.889097 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:44.889696 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:44.895723 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.896172 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:44.897058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:44.897492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:45.035477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:45.045121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ed2c0f8c-b077-491a-b77f-d8a2dc660223 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.159512 Aug 31 13:40:45.045735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 132/270] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:44 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:45.367139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:45.367843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:45.374958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:45.375410 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:45.376199 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:45.376668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:45.504121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:45.516607 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ef6fdaa3-a081-40b1-a5ee-f073dcf091ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.154937 Aug 31 13:40:45.517151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 133/271] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:45 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:45.528593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0d1ce644-c911-44ac-9c87-e7122b88fbfa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28256 microversion: 2.20 time: 2.356587 Aug 31 13:40:45.529234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 139/272] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:43 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28256 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:45.705018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:45.705641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:45.712053 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:45.712821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:45.713782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:45.714240 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:45.868726 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:45.877412 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e23866c5-b9cc-438b-8994-25cd3bb45025 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.175860 Aug 31 13:40:45.878034 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 134/273] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:45 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:45.901568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:45.901711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:45.909046 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:45.909490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:45.910266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:45.910988 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.043522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:46.051690 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3e48b6e7-5fee-4239-b9cf-743f593cb92d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.154996 Aug 31 13:40:46.052444 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 140/274] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:45 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:46.062556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:46.063195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:46.069434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.069876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.070640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.071066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.207921 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:46.215808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d052d9c6-ce36-4591-8b13-82628e0ba683 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.157003 Aug 31 13:40:46.216395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 135/275] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:46 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:46.533653 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:46.534214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:46.540809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.540984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:46.541374 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.542022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:46.542143 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.542586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.549643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.550150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.550974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.551404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.629593 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6bec0ae4-40e7-490e-a270-9fe8552f8965 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28256 microversion: 2.20 time: 0.092652 Aug 31 13:40:46.630255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 136/276] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:46 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28256 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:46.682112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:46.690081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-59c3a980-d27d-4b08-ad15-a897765f7a22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.160422 Aug 31 13:40:46.691058 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 141/277] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:46 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:46.896396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:46.897224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:46.905706 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.906152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:46.906939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:46.907375 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.054747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:47.063137 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ce7f5645-529e-43d0-83c2-474e34b5390e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1314 microversion: 2.1 time: 0.171217 Aug 31 13:40:47.063745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 137/278] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:46 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:47.070665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:47.071350 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:47.078401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.078876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.079640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.080153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.209233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:47.217151 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-77e3701c-4baf-443a-9690-b1f6f7966eaa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.150473 Aug 31 13:40:47.217776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 142/279] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:47 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:47.233150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:47.234021 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:47.240204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.240687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.241453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.241875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.384506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:47.391963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f7706c07-b052-4080-a1c1-3c0b423024d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.162660 Aug 31 13:40:47.392544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 138/280] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:47 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:47.645210 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:47.646527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:47.652912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.653454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.654348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.654831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.707644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:47.708291 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:47.715609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.716052 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.716872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.717304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.746374 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f0013905-fd96-4eb8-8170-f10041117ae5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28256 microversion: 2.20 time: 0.105179 Aug 31 13:40:47.747538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 143/281] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:47 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28256 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:47.851960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-01933168-9293-4c96-afec-e1cf1e43da02 req-d1fec1c3-4643-4dbd-8dd5-9888e0ea8746 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d383ef-a49f-4b9f-92f9-71b4b0493d96", "name": "network-vif-plugged", "status": "completed", "tag": "98e342d6-9a45-48b2-9686-3c8ca491c352"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:47.853654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:47.853654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:47.861138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:47.864396 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-01933168-9293-4c96-afec-e1cf1e43da02 req-d1fec1c3-4643-4dbd-8dd5-9888e0ea8746 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:47.864997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-01933168-9293-4c96-afec-e1cf1e43da02 req-d1fec1c3-4643-4dbd-8dd5-9888e0ea8746 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:47.871659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-94657bb4-ed48-4b67-97ae-3170f8460bae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.168245 Aug 31 13:40:47.872345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 139/282] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:47 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:47.879253 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-01933168-9293-4c96-afec-e1cf1e43da02 req-d1fec1c3-4643-4dbd-8dd5-9888e0ea8746 service nova] Creating event network-vif-plugged:98e342d6-9a45-48b2-9686-3c8ca491c352 for instance c7d383ef-a49f-4b9f-92f9-71b4b0493d96 on hv-cinder-80660 Aug 31 13:40:47.885256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-01933168-9293-4c96-afec-e1cf1e43da02 req-d1fec1c3-4643-4dbd-8dd5-9888e0ea8746 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038535 Aug 31 13:40:47.886373 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 144/283] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:40:48.081237 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:48.081941 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:48.094792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.095291 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.096171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.096718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.235074 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:48.235814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:48.242375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.242839 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.243983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.244141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.253628 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:48.261891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-372c4315-98d8-4354-a88e-cb774975b34d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1497 microversion: 2.1 time: 0.184958 Aug 31 13:40:48.262905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 140/284] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:48 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1497 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:48.390883 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:48.399102 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1cc97c97-a4cb-42df-b5ff-ecb39436f6d8 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.168182 Aug 31 13:40:48.399692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 145/285] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:48 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:48.447238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:48.448288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:48.458614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.459299 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.460562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.461259 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.608155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:48.617579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6e2f70e2-a22d-4c4c-8e12-60490d7b48ba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.177194 Aug 31 13:40:48.618545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 141/286] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:48 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:48.759369 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:48.760677 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:48.767485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.767925 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.768767 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.769187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.844717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-76151c79-3158-4666-ab76-5ad1993a1e1b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28256 microversion: 2.20 time: 0.088632 Aug 31 13:40:48.845684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 146/287] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:48 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28256 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:48.889159 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:48.889773 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:48.896016 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.896499 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.897287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.897721 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.974917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:48.975492 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:48.982353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.982792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:48.983574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:48.983996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.013045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:40:49.034785 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:49.044231 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a862eb5b-3f4d-48f2-9156-6aab5debb071 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.159061 Aug 31 13:40:49.044917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 142/288] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:48 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:49.095461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f503c067-46c7-40d1-ac23-2f03ca8f046d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 204 len: 0 microversion: 2.1 time: 0.124249 Aug 31 13:40:49.096228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 147/289] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:40:48 2021] DELETE /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:40:49.105269 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:49.105880 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:49.111779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.112212 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.113054 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.113485 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.259802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:49.268280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-37944c90-7ea8-4298-a4cd-a685ac5ea645 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1503 microversion: 2.1 time: 0.167514 Aug 31 13:40:49.269075 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 143/290] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:49 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:49.418156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:49.418854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:49.425432 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.426166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.426990 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.427450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.566875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:49.575223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-674ea998-cb89-4524-962e-1db214000577 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1318 microversion: 2.1 time: 0.161267 Aug 31 13:40:49.575861 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 148/291] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:49 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:49.637445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:49.638222 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:49.644310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.644813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.645719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.646103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.786709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:49.795067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-546b20c9-d20c-458c-b4f4-c0db376e3052 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.161563 Aug 31 13:40:49.795641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 144/292] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:49 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:49.858444 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:49.859369 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:49.865337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.865700 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.866491 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:49.866945 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:49.999326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8218ce19-3d89-45e8-a94b-59f26b7c0f94 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28256 microversion: 2.20 time: 0.144370 Aug 31 13:40:50.001357 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 149/293] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:49 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28256 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:50.062275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:50.062976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:50.069618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.070066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.070854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.071318 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.219654 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:50.227336 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8544f569-2eaa-49e4-9e35-8e3b4bd9419f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.168993 Aug 31 13:40:50.231886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 145/294] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:50 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:50.286910 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:50.287619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:50.294880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.295322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.296093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.296546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.592192 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:50.593043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:50.599973 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.600551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.601426 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.602042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.673119 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:50.684881 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9d01538c-8c3b-4667-88da-8a7c8e5d910e tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1503 microversion: 2.1 time: 0.402741 Aug 31 13:40:50.685474 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 150/295] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:50 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1503 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:50.743791 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:50.751911 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fe07edad-b822-45dc-9f7b-43c93e9652ed tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1508 microversion: 2.1 time: 0.163612 Aug 31 13:40:50.752527 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 146/296] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:50 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1508 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:50.817228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:50.818422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:50.831324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.832947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:50.834470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:50.836080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.012948 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:51.014199 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:51.022181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.027285 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.028263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.028815 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.060993 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:51.071704 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8ceb0fa2-756e-499a-9fc1-9db7dda81bd5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.257947 Aug 31 13:40:51.074146 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 151/297] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:50 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:51.147267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f1968cac-f31d-4a0e-96fb-2a904b91352a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28256 microversion: 2.20 time: 0.139505 Aug 31 13:40:51.151451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 147/298] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:51 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28256 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:51.247725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:51.248489 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:51.264794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.265466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.266416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.266997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.422403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:51.432709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6ed13b60-f433-4db1-a584-4e06100a76b5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.188617 Aug 31 13:40:51.433501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 152/299] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:51 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:51.707148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:51.709611 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:51.728461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.731114 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.735327 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.735780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.742128 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-03fc01a0-3a92-4070-b2a0-33ad84d35888 req-8562a94c-5c1f-45c6-9711-3735e4cdaf21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600915c4-ecf3-4004-8c57-260a462152a7", "name": "network-vif-plugged", "status": "completed", "tag": "abeb489f-0045-481c-8ee8-424a975cb388"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:51.743989 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:51.743989 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:51.752976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-03fc01a0-3a92-4070-b2a0-33ad84d35888 req-8562a94c-5c1f-45c6-9711-3735e4cdaf21 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:51.753730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-03fc01a0-3a92-4070-b2a0-33ad84d35888 req-8562a94c-5c1f-45c6-9711-3735e4cdaf21 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:51.767384 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-03fc01a0-3a92-4070-b2a0-33ad84d35888 req-8562a94c-5c1f-45c6-9711-3735e4cdaf21 service nova] Creating event network-vif-plugged:abeb489f-0045-481c-8ee8-424a975cb388 for instance 600915c4-ecf3-4004-8c57-260a462152a7 on hv-cinder-80660 Aug 31 13:40:51.774141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-03fc01a0-3a92-4070-b2a0-33ad84d35888 req-8562a94c-5c1f-45c6-9711-3735e4cdaf21 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035637 Aug 31 13:40:51.777960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 153/300] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:40:52.014619 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:52.022300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-eff238d4-06a9-43ce-8b65-810d7d52e3e2 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1503 microversion: 2.1 time: 0.321911 Aug 31 13:40:52.023140 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 148/301] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:51 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1503 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:52.092751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:52.094043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:52.103656 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:52.104171 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:52.105190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:52.105606 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:52.159398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:52.160427 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:52.168739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:52.173966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:52.176632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:52.177746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:52.330702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:52.339981 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6c42a0c7-2f1a-46ef-844c-feb597b87b84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.252430 Aug 31 13:40:52.342145 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 154/302] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:52 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:52.356457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6d4786c-3297-4202-923c-4fa1b2584a28"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:52.357675 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:52.363963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:52.364590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:52.365426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:52.366139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:54.923635 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-96d51446-c19b-457e-87c3-3a66595fdbf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28543 microversion: 2.20 time: 2.767565 Aug 31 13:40:54.925267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 149/303] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:52 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28543 bytes in 2770 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:54.933105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-f15e3c61-a81d-4079-bef7-b5ce0c13af55 req-1a6f06c1-aa07-4f3d-b55b-972585b65864 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3d15babf-70c0-4706-9266-567d649aca84", "name": "network-vif-deleted", "tag": "472e99bf-8ad9-4b67-ab61-3811882ef14a"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:54.935665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:54.935665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:40:54.947922 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f15e3c61-a81d-4079-bef7-b5ce0c13af55 req-1a6f06c1-aa07-4f3d-b55b-972585b65864 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:54.948917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f15e3c61-a81d-4079-bef7-b5ce0c13af55 req-1a6f06c1-aa07-4f3d-b55b-972585b65864 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:54.963498 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-f15e3c61-a81d-4079-bef7-b5ce0c13af55 req-1a6f06c1-aa07-4f3d-b55b-972585b65864 service nova] Creating event network-vif-deleted:472e99bf-8ad9-4b67-ab61-3811882ef14a for instance 3d15babf-70c0-4706-9266-567d649aca84 on hv-cinder-80660 Aug 31 13:40:54.969097 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-f15e3c61-a81d-4079-bef7-b5ce0c13af55 req-1a6f06c1-aa07-4f3d-b55b-972585b65864 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042011 Aug 31 13:40:54.970319 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 150/304] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:54.980632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:54.981404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:54.989193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:54.989669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:54.990633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:54.991269 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.077206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0337d741-36d6-4c24-8ad5-3ffc0e6a2b89 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.725540 Aug 31 13:40:55.078201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 155/305] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:40:52 2021] POST /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments => generated 194 bytes in 2737 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:55.083309 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:55.084065 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:55.093846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.094523 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.095287 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.095711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.128326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.128800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.129402 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lazy-loading 'fault' on Instance uuid 3d15babf-70c0-4706-9266-567d649aca84 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:40:55.139875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:55.149312 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-73563249-4e93-4569-9bc7-2355b48768cf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.175293 Aug 31 13:40:55.149890 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 151/306] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:54 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:55.154663 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:55.155280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:55.161370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.161835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.162605 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.163036 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.180661 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:55.188316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-03919a7d-c53c-446b-8449-a23821548700 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 200 len: 1304 microversion: 2.1 time: 0.108906 Aug 31 13:40:55.188963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 156/307] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:55 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 1304 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:55.299927 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:55.308019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f4bd45fe-647c-49f2-b43e-21310ac6c5bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.157155 Aug 31 13:40:55.309034 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 152/308] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:55 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:55.690709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-937779060", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "a5c20a69-0932-4886-a293-fa89c7cd66cd"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:55.750530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] validate_networks() for [('a5c20a69-0932-4886-a293-fa89c7cd66cd', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:40:55.937782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:55.938787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:55.945113 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.945951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:55.946736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:55.947319 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.037914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4614206f-8e9a-43eb-96a2-bfb4b0c8e725 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28543 microversion: 2.20 time: 0.104786 Aug 31 13:40:56.038622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 153/309] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:55 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28543 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:56.151091 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:40:56.151632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:40:56.152605 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:40:56.152605 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:40:56.153251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:40:56.164097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.164611 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.165608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.166052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.169008 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:56.170056 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:56.177740 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.178301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.179354 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.179812 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.190506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Getting quotas for project 5651d65709fb486eb25e57054dc889cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:56.194826 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Getting quotas for user dfba192291f64cab941d1006c81380bc and project 5651d65709fb486eb25e57054dc889cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:56.217708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:40:56.222259 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:40:56.272234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4ad8b93e-f11b-4fbc-b4a7-07193a2ca5ae tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.585200 Aug 31 13:40:56.273243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 157/310] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:40:55 2021] POST /compute/v2.1/servers => generated 380 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:40:56.277952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:56.278654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: 3d15babf-70c0-4706-9266-567d649aca84] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:56.289847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.293110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.294956 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.295461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.311305 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] HTTP exception thrown: Instance 3d15babf-70c0-4706-9266-567d649aca84 could not be found. Aug 31 13:40:56.312134 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Returning 404 to user: Instance 3d15babf-70c0-4706-9266-567d649aca84 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:40:56.313067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2448f121-9fe0-4ee3-9dbc-0d22b75f1214 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84" status: 404 len: 111 microversion: 2.1 time: 0.038972 Aug 31 13:40:56.313568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 158/311] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:56 2021] GET /compute/v2.1/servers/3d15babf-70c0-4706-9266-567d649aca84 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:40:56.318185 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-30222e68-e90d-4a40-84de-9806f5a6433e tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:56.318779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-30222e68-e90d-4a40-84de-9806f5a6433e tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:56.344673 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:56.356931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b86b7c6c-cbd0-41d3-b1a5-4d934cfa27de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1361 microversion: 2.1 time: 0.192362 Aug 31 13:40:56.357557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 154/312] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:56 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:56.368103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:56.368753 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:56.378452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-30222e68-e90d-4a40-84de-9806f5a6433e tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:56.382164 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.382934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.386147 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-30222e68-e90d-4a40-84de-9806f5a6433e tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1218 microversion: 2.1 time: 0.071395 Aug 31 13:40:56.386721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 159/313] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:56 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1218 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:56.388528 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.389634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.462082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1838876131", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "8ee43288-e7ed-4568-96cb-42de300ea126"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:56.520823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] validate_networks() for [('8ee43288-e7ed-4568-96cb-42de300ea126', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:40:56.530687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:56.539256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9b6e1a9b-3b3f-4550-9c33-b8c78781df39 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.179882 Aug 31 13:40:56.540211 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 155/314] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:56 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:56.969896 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:40:56.970551 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:40:56.971043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:40:56.971459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:40:56.971876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:40:56.982376 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.982819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:56.983614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:56.984044 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.001724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Getting quotas for project c037b436492542b99cf63627ac6af982. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:40:57.005713 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Getting quotas for user fbb73d40aa804f87aa1bf30a98ee35c7 and project c037b436492542b99cf63627ac6af982. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:40:57.017059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:40:57.019292 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:40:57.050717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:57.051744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:57.058047 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.058579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.059522 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.060220 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.070066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f8a2dd16-2f2b-473b-9665-783c22799523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.612621 Aug 31 13:40:57.070918 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 160/315] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:40:56 2021] POST /compute/v2.1/servers => generated 380 bytes in 614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:40:57.082471 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3541880d-c395-4772-8819-6de8a9614776 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:57.083550 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3541880d-c395-4772-8819-6de8a9614776 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:57.140937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3541880d-c395-4772-8819-6de8a9614776 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:57.147546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3541880d-c395-4772-8819-6de8a9614776 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1214 microversion: 2.1 time: 0.070266 Aug 31 13:40:57.148116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 161/316] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:57 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:57.173873 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-35aae84f-0492-4c7f-aaf6-6c22f541ab40 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.126908 Aug 31 13:40:57.174888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 156/317] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:57 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:57.374478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:57.375118 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:57.381239 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.381691 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.382426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.383241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.407122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:57.408641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:57.417566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.418507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.420117 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.420767 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.498905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:57.509067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6549b847-a01e-4ef1-95ea-61ce879d02cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1270 microversion: 2.1 time: 0.109202 Aug 31 13:40:57.509648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 157/318] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:57 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1270 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:57.548809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:57.556789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:57.557750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:57.559640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5c21d47b-5f3b-4030-b358-888feaa265ba tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1547 microversion: 2.1 time: 0.189011 Aug 31 13:40:57.564869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.565430 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.566331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.566899 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.571874 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 162/319] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:57 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1547 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:57.577344 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:57.578027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:57.585706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.586393 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.587341 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:57.587931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:57.688640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-29b2f941-1641-4589-8818-cbe2a43e5871 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.115091 Aug 31 13:40:57.689799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 163/320] 10.222.0.21 () {58 vars in 1275 bytes} [Tue Aug 31 13:40:57 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-interface => generated 284 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:57.828767 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:57.840614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ee7f7cbd-6503-48a8-9e07-c3cf2729b107 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.287537 Aug 31 13:40:57.841454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 158/321] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:57 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:58.166158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:58.167107 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:58.174403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.174824 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.175822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.176436 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.186052 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:58.186976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:58.193022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.193698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.194633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.195218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.291699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3b8afa61-1d29-4afc-8d9b-216a9b977007 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.109822 Aug 31 13:40:58.293559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 159/322] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:58 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:40:58.299094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:58.307557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-53371c18-2c3b-4d62-beb5-3242a7f45f64 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1266 microversion: 2.1 time: 0.146211 Aug 31 13:40:58.318890 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 164/323] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:58 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:58.531203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:58.533345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:58.541523 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.542249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.544086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.544786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.857510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:58.858139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:58.866173 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.867668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.868771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:58.869440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:58.928516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:58.938302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5315ac27-a2ef-4517-a84c-6a10731ee410 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.414786 Aug 31 13:40:58.938890 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 160/324] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:58 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:59.090713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:59.100740 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:59.121845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:59.129463 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8beb8abc-1dff-4f0a-913b-c5ae33d88c55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.275845 Aug 31 13:40:59.133984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.134433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.135221 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.135644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.138575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 165/325] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:58 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:40:59.155355 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-38449b2b-a8c5-4ae5-981b-32fa6af33e4f req-28907bbf-96d1-4e70-939b-6639bfac67b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "600915c4-ecf3-4004-8c57-260a462152a7", "tag": "abeb489f-0045-481c-8ee8-424a975cb388"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:59.157169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:40:59.157169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:40:59.164699 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-38449b2b-a8c5-4ae5-981b-32fa6af33e4f req-28907bbf-96d1-4e70-939b-6639bfac67b2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.165432 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-38449b2b-a8c5-4ae5-981b-32fa6af33e4f req-28907bbf-96d1-4e70-939b-6639bfac67b2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.180408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-38449b2b-a8c5-4ae5-981b-32fa6af33e4f req-28907bbf-96d1-4e70-939b-6639bfac67b2 service nova] Creating event network-changed:abeb489f-0045-481c-8ee8-424a975cb388 for instance 600915c4-ecf3-4004-8c57-260a462152a7 on hv-cinder-80660 Aug 31 13:40:59.186212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-38449b2b-a8c5-4ae5-981b-32fa6af33e4f req-28907bbf-96d1-4e70-939b-6639bfac67b2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045507 Aug 31 13:40:59.187109 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 166/326] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:40:59 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:40:59.244559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ff9e7494-d8f4-4a60-ae74-cdbf00d19f7f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.171804 Aug 31 13:40:59.245996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 161/327] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:40:59 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:40:59.305810 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:40:59.307067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:59.314116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.314565 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.315465 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.316056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.327425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:59.328630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:59.335333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.352826 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.354308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.354308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.445907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0dbcce62-7777-49e8-9e23-5c701d32bb3b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.144012 Aug 31 13:40:59.450290 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 167/328] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:40:59 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:40:59.512539 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:40:59.520691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d71511db-2619-4c63-a4bd-e7bb15f72366 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1272 microversion: 2.1 time: 0.198183 Aug 31 13:40:59.526351 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 162/329] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:59 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1272 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:40:59.957868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:40:59.958556 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:40:59.970095 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.970724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:40:59.971597 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:40:59.972086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.119927 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:00.126894 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-1649e0e1-9bf2-44c6-8fee-3749c3aac38e req-0e66d1e9-eb86-4f83-888e-2da83535311b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fb6ec340-96e6-4018-933b-e3b1623e65da", "tag": "946c3d14-63a6-44c9-afa6-783cd0c69a85"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:00.130515 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4f65f8b8-1d71-4ba6-9f50-c6b20e325c53 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.177192 Aug 31 13:41:00.131884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 168/330] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:40:59 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:00.141489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:00.141489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:41:00.145180 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-1649e0e1-9bf2-44c6-8fee-3749c3aac38e req-0e66d1e9-eb86-4f83-888e-2da83535311b service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.145180 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-1649e0e1-9bf2-44c6-8fee-3749c3aac38e req-0e66d1e9-eb86-4f83-888e-2da83535311b service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.158017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:00.159214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:00.163686 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-1649e0e1-9bf2-44c6-8fee-3749c3aac38e req-0e66d1e9-eb86-4f83-888e-2da83535311b service nova] Creating event network-changed:946c3d14-63a6-44c9-afa6-783cd0c69a85 for instance fb6ec340-96e6-4018-933b-e3b1623e65da on hv-cinder-80660 Aug 31 13:41:00.169016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.170146 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.170420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-1649e0e1-9bf2-44c6-8fee-3749c3aac38e req-0e66d1e9-eb86-4f83-888e-2da83535311b service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048224 Aug 31 13:41:00.171495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 163/331] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:00 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:41:00.171635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.172218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.258491 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:00.259517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:00.267803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.268250 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.270244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.271015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.331255 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:00.340256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1c744f13-12f7-4e07-9240-78ece7f7e106 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.188703 Aug 31 13:41:00.351789 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 169/332] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:00 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:00.416225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-50d73f65-67c8-42ab-ba13-96e2d3f218fb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.162632 Aug 31 13:41:00.417903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 164/333] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:00 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:00.461434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:00.462517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:00.468675 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.469213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.481260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.489110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.545238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:00.546185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:00.558176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.562625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.564327 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:00.566560 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:00.631137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-713981a6-1b2a-4af9-8684-3a8849ea5df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.172655 Aug 31 13:41:00.631935 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 170/334] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:00 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:01.039158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:01.053339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-15a2857e-1c4f-4c1e-8a68-12f00c5c3b9f tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.513652 Aug 31 13:41:01.054042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 165/335] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:00 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:01.150672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:01.151554 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.162623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.163770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.165254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.166007 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.357621 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:01.359009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.365530 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.366196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.367150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.367775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.404389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:01.424307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-320611d9-b0af-45f7-a993-585f53de979b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.278466 Aug 31 13:41:01.425191 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 171/336] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:01 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:01.431319 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:01.432527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.438884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.439796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.440264 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.440847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.546082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bc092083-c4c4-4a72-b9d2-98e5cf96d543 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.118903 Aug 31 13:41:01.552955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 172/337] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:01 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:01.645391 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:01.646437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.656331 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.656711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.658785 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.659639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.716501 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:01.743746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c8ffed74-9663-404b-973f-0a156edb92be tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1503 microversion: 2.1 time: 0.389586 Aug 31 13:41:01.744939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 166/338] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:01 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1503 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:01.770263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f1c4654-8f13-4290-b8fd-eee16dd61246"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:01.772480 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f9c6dc74-e05d-49d2-88f9-500d8e580dd5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.132121 Aug 31 13:41:01.777303 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 173/339] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:01 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:01.778336 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.787470 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.788080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.789661 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.790239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.822843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] HTTP exception thrown: Cannot 'attach_volume' instance 15246791-5821-4746-ab57-de3340921964 while it is in vm_state rescued Aug 31 13:41:01.823683 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Returning 409 to user: Cannot 'attach_volume' instance 15246791-5821-4746-ab57-de3340921964 while it is in vm_state rescued {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:41:01.825043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-893b7589-eb31-487e-bf1b-18874665fc1e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.067182 Aug 31 13:41:01.830535 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 167/340] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:41:01 2021] POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 152 bytes in 72 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 13:41:01.837620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:01.838233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.846432 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.847821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.848830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.849626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.950999 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6a84eb29-dda8-41e4-a454-4a37eb50b2ca tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action" status: 202 len: 0 microversion: 2.1 time: 0.117624 Aug 31 13:41:01.965633 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 174/341] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:01 2021] POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action => generated 0 bytes in 134 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:01.976895 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:01.977657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:01.986280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.986781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:01.988583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:01.989107 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.073913 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:02.075103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:02.083654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.084735 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.085720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.086426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.342700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:02.352256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9ba209fc-b04d-473d-a714-ad7273a9b78f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1511 microversion: 2.1 time: 0.379592 Aug 31 13:41:02.353141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 168/342] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:01 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1511 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:02.360404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-7223fd28-ccec-4f54-b15f-0b546bfd5200 req-38ccf7b2-5de7-4340-a204-4a544c49cd34 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df25a5e6-7fd6-4319-a15c-bda6cf37b7d0", "tag": "adbcec59-4752-42d2-a4d9-acc303306d91"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:02.362154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:02.362154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:41:02.366692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:02.371811 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-7223fd28-ccec-4f54-b15f-0b546bfd5200 req-38ccf7b2-5de7-4340-a204-4a544c49cd34 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.372074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-7223fd28-ccec-4f54-b15f-0b546bfd5200 req-38ccf7b2-5de7-4340-a204-4a544c49cd34 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.377209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e365ed37-b3c6-4ce4-93d3-a3b7367b01ee tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.309589 Aug 31 13:41:02.387745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 175/343] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:02 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:02.394953 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-7223fd28-ccec-4f54-b15f-0b546bfd5200 req-38ccf7b2-5de7-4340-a204-4a544c49cd34 service nova] Creating event network-changed:adbcec59-4752-42d2-a4d9-acc303306d91 for instance df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 on hv-cinder-80660 Aug 31 13:41:02.400868 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-7223fd28-ccec-4f54-b15f-0b546bfd5200 req-38ccf7b2-5de7-4340-a204-4a544c49cd34 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045679 Aug 31 13:41:02.401551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 169/344] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:02.443966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:02.444174 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:02.453061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.453513 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.454314 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.454907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.559439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:02.561045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:02.568734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.569501 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.570492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.571104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.662567 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c80593c3-c06b-4f2b-9615-3477bf5e3580 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.107680 Aug 31 13:41:02.667346 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 170/345] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:02 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:02.704285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:02.711912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ac771a5c-0628-4f0d-be4e-3049f7364113 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.273459 Aug 31 13:41:02.712839 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 176/346] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:02 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:02.786600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:02.788104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:02.802905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.807627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.808766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.810670 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.953429 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-99e65373-c3a4-4eb5-a8de-6370954a1c41 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.172496 Aug 31 13:41:02.957533 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d6d4786c-3297-4202-923c-4fa1b2584a28"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:02.958422 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 171/347] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:02 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:02.958766 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:02.972918 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.973686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:02.974451 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:02.975062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.086423 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] HTTP exception thrown: Invalid volume: volume d6d4786c-3297-4202-923c-4fa1b2584a28 is already attached to instances: c7d383ef-a49f-4b9f-92f9-71b4b0493d96 Aug 31 13:41:03.087111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Returning 400 to user: Invalid volume: volume d6d4786c-3297-4202-923c-4fa1b2584a28 is already attached to instances: c7d383ef-a49f-4b9f-92f9-71b4b0493d96 {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:41:03.088269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b5180d47-1a39-40d6-9d90-89c315701b06 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.135055 Aug 31 13:41:03.090186 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 177/348] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:41:02 2021] POST /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments => generated 174 bytes in 138 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:41:03.204179 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:03.204771 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.211469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.211918 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.213385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.213833 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.353121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'services' on Instance uuid c7d383ef-a49f-4b9f-92f9-71b4b0493d96 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:41:03.370601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:03.372272 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.379231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.379957 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.380970 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.381725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.479411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2754a8a7-8724-4861-a600-b2f77bb7d781 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments/d6d4786c-3297-4202-923c-4fa1b2584a28" status: 202 len: 0 microversion: 2.1 time: 0.279527 Aug 31 13:41:03.481452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 172/349] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:41:03 2021] DELETE /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments/d6d4786c-3297-4202-923c-4fa1b2584a28 => generated 0 bytes in 282 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:03.489445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:03.490515 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.499109 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.499719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.500648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.501194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.545412 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:03.553399 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-397245eb-de0b-4d98-86c2-251fd45994b8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1511 microversion: 2.1 time: 0.186466 Aug 31 13:41:03.554292 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 178/350] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:03 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1511 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:03.563850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:03.565048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.578686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.579321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.580238 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.580838 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.613569 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4ac6236c-4d02-4701-a9b2-b19065473a6c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058115 Aug 31 13:41:03.614263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 179/351] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:03 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:03.658774 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:03.669436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-252e0f77-aba0-4ae9-9a7f-7dfccbf67bb7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.185968 Aug 31 13:41:03.669989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 173/352] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:03 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:03.674842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:03.675779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.682168 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.682553 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.683378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.683821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.729987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:03.730603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.737247 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.737699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.738470 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.738904 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.797654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3f035fb9-09b1-4222-b9c3-ce58fabe8244 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.126451 Aug 31 13:41:03.798612 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 180/353] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:03 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:03.870282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:03.878366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-32c7e9f9-761a-4f32-9d65-e59dfdb9277b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.151656 Aug 31 13:41:03.883512 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 174/354] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:03 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:03.966951 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:03.967976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:03.975504 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.975947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:03.976771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:03.977194 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.074906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ff65140c-3ded-44a0-839c-50b0a6567bf6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.112491 Aug 31 13:41:04.075600 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 181/355] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:03 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:04.571197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:04.571837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:04.579203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.579698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.580601 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.580965 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.625901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:04.627015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:04.637437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.637930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.639143 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.639915 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.672484 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f1fcec1d-5965-42ab-b095-2f319d41e5c4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051310 Aug 31 13:41:04.673094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 182/356] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:04 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:04.685671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:04.686426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:04.692230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.692699 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.693486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.693911 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.713011 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:04.720322 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0e925925-062e-47c1-ac54-7a79e3927f45 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1511 microversion: 2.1 time: 0.153023 Aug 31 13:41:04.720889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 175/357] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:04 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1511 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:04.809393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:04.810499 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:04.817858 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.818355 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.819273 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.819711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.829221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:04.837342 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b97bcda8-9e92-4e94-a441-88496043420c tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.155054 Aug 31 13:41:04.837990 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 183/358] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:04 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:04.895837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:04.896491 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:04.905878 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.906549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:04.906839 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1295f724-287a-4c52-902f-48d3b627fa92 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.100796 Aug 31 13:41:04.907727 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:04.907859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 176/359] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:04 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:04.908559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.043296 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:05.052240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fd54d40e-7074-4945-9f9d-382755801d69 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.160034 Aug 31 13:41:05.052937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 184/360] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:04 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:05.087135 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:05.088280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:05.095730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.096174 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.097002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.097433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.194600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-25d4565f-cf4e-47ed-b2bd-436b6ce3f65d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28707 microversion: 2.20 time: 0.111475 Aug 31 13:41:05.196111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 177/361] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:05 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28707 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:05.687707 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:05.688780 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:05.695992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.696445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.697447 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.697872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.728901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-228223ef-14e4-4334-8b01-4a3b70f0a855 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047309 Aug 31 13:41:05.729197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 185/362] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:05 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:05.739458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:05.739458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:05.746279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.746730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.747571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.748090 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.854656 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:05.855572 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:05.863071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.863819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.864687 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.865304 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.934442 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:05.942606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-21dd372c-9510-418b-9517-bed27381ad02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1511 microversion: 2.1 time: 0.208571 Aug 31 13:41:05.944000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 178/363] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:05 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1511 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:05.948111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:05.949045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:05.955007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.955548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:05.956199 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:05.957011 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.002511 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:06.010423 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-334389db-cc3d-4afb-b57f-d34f2a3e4d68 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.160441 Aug 31 13:41:06.011012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 186/364] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:05 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:06.015600 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1079984296", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "fa07179d-dd48-41cb-8301-642273bf3aa6"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:06.071382 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c584695e-2448-4a73-a625-f8fd41100037 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.126925 Aug 31 13:41:06.072036 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 179/365] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:05 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:06.077005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:06.077717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:06.079756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] validate_networks() for [('fa07179d-dd48-41cb-8301-642273bf3aa6', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:41:06.084780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.085224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.085987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.086396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.218771 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:06.227439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c5760e80-dd40-4aa3-85ae-ae4f3ad12aa6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.154101 Aug 31 13:41:06.228364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 180/366] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:06 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:06.232807 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:06.233719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:06.241803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.242252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.243029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.243466 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.353328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-96ad9629-daea-4a65-ba1d-f39e80913355 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 28826 microversion: 2.20 time: 0.123886 Aug 31 13:41:06.354013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 181/367] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:06 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 28826 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:06.507222 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:41:06.508036 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:41:06.508533 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:41:06.508967 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:41:06.509404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:41:06.521430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.521894 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.522888 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.523100 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.541539 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:41:06.546032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Getting quotas for user cde9252205de47b2897144a70d230022 and project a9d8392a09c34c68a6b4f4beb18b7f1c. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:41:06.556740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:41:06.559245 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:41:06.607375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-23fc9882-e125-4687-8d7a-8c956f47b5fa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594994 Aug 31 13:41:06.608235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 187/368] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:41:06 2021] POST /compute/v2.1/servers => generated 380 bytes in 597 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:41:06.620991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-677e7ea2-ccf7-4c9a-83b0-f5f88064874d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:06.621677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-677e7ea2-ccf7-4c9a-83b0-f5f88064874d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:06.681979 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-677e7ea2-ccf7-4c9a-83b0-f5f88064874d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:06.689340 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-677e7ea2-ccf7-4c9a-83b0-f5f88064874d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1218 microversion: 2.1 time: 0.072516 Aug 31 13:41:06.689934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 182/369] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:06 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:06.959392 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:06.960250 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:06.966942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.967408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:06.968406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:06.968847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.027139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:07.028548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:07.035830 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.036633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.037556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.038126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.119082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:07.128097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2456355b-fe0a-4227-8e58-d4f9ef54355e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1517 microversion: 2.1 time: 0.172417 Aug 31 13:41:07.128841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 188/370] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:06 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1517 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:07.134908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:07.136189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:07.152194 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.156881 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.160745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.161199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.211620 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:07.219148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-15f77dda-dab8-4377-b0a7-7698b9bc46f5 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.195730 Aug 31 13:41:07.219944 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 183/371] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:07 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:07.234772 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-f4628d3a-a901-4330-b9bd-49faa9a8637a req-16657b98-0d5e-4b83-af0c-c369f401fed7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6ec340-96e6-4018-933b-e3b1623e65da", "name": "network-vif-plugged", "status": "completed", "tag": "946c3d14-63a6-44c9-afa6-783cd0c69a85"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:07.237317 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:07.237317 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:41:07.246819 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f4628d3a-a901-4330-b9bd-49faa9a8637a req-16657b98-0d5e-4b83-af0c-c369f401fed7 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.247251 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f4628d3a-a901-4330-b9bd-49faa9a8637a req-16657b98-0d5e-4b83-af0c-c369f401fed7 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.262702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-f4628d3a-a901-4330-b9bd-49faa9a8637a req-16657b98-0d5e-4b83-af0c-c369f401fed7 service nova] Creating event network-vif-plugged:946c3d14-63a6-44c9-afa6-783cd0c69a85 for instance fb6ec340-96e6-4018-933b-e3b1623e65da on hv-cinder-80660 Aug 31 13:41:07.273204 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fb345d51-936e-4296-8ce7-d503ebb031e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.142770 Aug 31 13:41:07.276342 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 189/372] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:07 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:07.276621 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-f4628d3a-a901-4330-b9bd-49faa9a8637a req-16657b98-0d5e-4b83-af0c-c369f401fed7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042843 Aug 31 13:41:07.276621 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 184/373] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:07 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:07.281012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:07.281708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:07.288568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.289006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.289814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.290240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.368138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:07.369569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:07.377484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.378268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.379337 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.380044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.449052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:07.461567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-124845fd-e713-468c-b880-0c21938985bd tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.186304 Aug 31 13:41:07.462183 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 190/374] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:07 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:07.488764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6fbd79c6-e8eb-4040-b28b-8aeb336d8f69 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 30655 microversion: 2.20 time: 0.126365 Aug 31 13:41:07.492641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 185/375] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:07 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 30655 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:07.706860 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:07.707459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:07.713955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.714399 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.715157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:07.715580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:07.784900 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:07.792762 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9ec9ddff-efba-4b65-8a14-1007d1d0e165 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1270 microversion: 2.1 time: 0.089837 Aug 31 13:41:07.793316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 191/376] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:07 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1270 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:08.237079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:08.237881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.245181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.245518 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.246307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.246727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.283968 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:08.285505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.299448 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.299895 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.300882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.301315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.400000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a38e1cb3-c886-4eae-957f-43971b62ea17 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.120342 Aug 31 13:41:08.400710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 192/377] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:08 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:41:08.449137 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:08.457044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-74c25992-6fc5-40ce-afc5-2d7eb55137f4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.223988 Aug 31 13:41:08.466451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 186/378] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:08 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:08.479887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:08.480669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.487913 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.488357 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.489239 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.489708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.502051 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:08.503356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.512691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.513622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.514662 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.515262 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.632390 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:08.641801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7f6988cd-2c7d-4f29-b97b-2d2e21cd6f5c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1318 microversion: 2.1 time: 0.165932 Aug 31 13:41:08.642727 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 193/379] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:08 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:08.647580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:08.648458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.652787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-03a238f3-e0c3-4d50-9f81-e2e6d5f99394 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 31710 microversion: 2.20 time: 0.154265 Aug 31 13:41:08.653851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 187/380] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:08 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 31710 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:41:08.655749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.656199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.657027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.657456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.787075 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:08.797235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2e1d179d-6e04-4952-8152-5899cacd9e9e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1517 microversion: 2.1 time: 0.153393 Aug 31 13:41:08.797809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 194/381] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:08 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1517 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:08.810813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:08.811713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.814458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "721c28e7-b3d1-4dcc-9cac-b7b2a687eedd"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:08.815644 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:08.818811 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.819480 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.820224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.821029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.822249 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.823075 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.824228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:08.824425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:08.899123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:08.910390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3f2381c0-1e26-4a86-b56d-8f29b138e055 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1276 microversion: 2.1 time: 0.103516 Aug 31 13:41:08.911170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 188/382] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:08 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1276 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:09.119681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cf85ca86-582a-4f4d-a55a-2aae8e1ab32f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308958 Aug 31 13:41:09.137795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 195/383] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:41:08 2021] POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 194 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:09.313608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-4c9ed441-f0a7-4b5c-8bc2-6b746a80ccd8 req-6802d7a6-a67b-4263-8cd6-9c63d3dd78e7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df25a5e6-7fd6-4319-a15c-bda6cf37b7d0", "name": "network-vif-plugged", "status": "completed", "tag": "adbcec59-4752-42d2-a4d9-acc303306d91"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:09.315920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:09.315920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:41:09.330289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-4c9ed441-f0a7-4b5c-8bc2-6b746a80ccd8 req-6802d7a6-a67b-4263-8cd6-9c63d3dd78e7 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.334566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-4c9ed441-f0a7-4b5c-8bc2-6b746a80ccd8 req-6802d7a6-a67b-4263-8cd6-9c63d3dd78e7 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.360037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-4c9ed441-f0a7-4b5c-8bc2-6b746a80ccd8 req-6802d7a6-a67b-4263-8cd6-9c63d3dd78e7 service nova] Creating event network-vif-plugged:adbcec59-4752-42d2-a4d9-acc303306d91 for instance df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 on hv-cinder-80660 Aug 31 13:41:09.367181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-4c9ed441-f0a7-4b5c-8bc2-6b746a80ccd8 req-6802d7a6-a67b-4263-8cd6-9c63d3dd78e7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057836 Aug 31 13:41:09.368123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 189/384] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:09.413879 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:09.415985 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:09.425233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.426113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.426890 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.427340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.475204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:09.475900 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:09.486376 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.489777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.490655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.494333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.610283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f6614596-f352-4ce4-aa81-c3e9efd1d787 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.202286 Aug 31 13:41:09.614885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 196/385] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:09 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:41:09.660041 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:09.661059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:09.668213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.668748 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.669519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.670251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.754658 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:09.763008 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ff70f610-bddc-4023-8088-59de4c7ba38d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.292789 Aug 31 13:41:09.763656 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 190/386] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:09 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:09.769395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:09.770765 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:09.777868 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.779114 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.780188 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.780697 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.811313 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:09.819307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-23966b53-3614-4a9d-adab-c2ffef6052cb tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1506 microversion: 2.1 time: 0.163527 Aug 31 13:41:09.819895 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 197/387] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:09 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1506 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:09.934981 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:09.936157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:09.942678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.943366 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:09.944337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:09.944799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:10.125582 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:10.132979 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e1ca5166-5424-45e4-9290-32db54179c4f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 32457 microversion: 2.20 time: 0.366783 Aug 31 13:41:10.134148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 191/388] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:09 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 32457 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:10.140324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5fc671e6-08f2-4f14-a9c3-de3babbab8cc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.209126 Aug 31 13:41:10.150495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 198/389] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:09 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:10.170229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-44ea0668-ee77-468d-a3f8-b02eec22f21b req-3e1b8851-feae-4f14-a00d-0b4a574d392d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cf4ea845-2852-420f-845a-a97af7125ae0", "tag": "42ff9e47-16dd-4b52-a820-b31d0a17af0c"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:10.172865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:10.172865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:41:10.190045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-44ea0668-ee77-468d-a3f8-b02eec22f21b req-3e1b8851-feae-4f14-a00d-0b4a574d392d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:10.190698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-44ea0668-ee77-468d-a3f8-b02eec22f21b req-3e1b8851-feae-4f14-a00d-0b4a574d392d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:10.212456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-44ea0668-ee77-468d-a3f8-b02eec22f21b req-3e1b8851-feae-4f14-a00d-0b4a574d392d service nova] Creating event network-changed:42ff9e47-16dd-4b52-a820-b31d0a17af0c for instance cf4ea845-2852-420f-845a-a97af7125ae0 on hv-cinder-80660 Aug 31 13:41:10.231788 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-44ea0668-ee77-468d-a3f8-b02eec22f21b req-3e1b8851-feae-4f14-a00d-0b4a574d392d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071076 Aug 31 13:41:10.232790 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 192/390] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:10 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:41:10.632123 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:10.632123 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:10.634777 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:10.635225 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:10.636034 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:10.636509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:10.776816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ceee3d05-47af-4d75-b150-5eeeab954227 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.157213 Aug 31 13:41:10.777458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 199/391] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:10 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:10.781115 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:10.782315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:10.789731 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:10.790184 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:10.790963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:10.791398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:10.985539 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:10.994104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-102c6e73-0766-49e5-bdd2-1318e99b3523 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.217421 Aug 31 13:41:10.994688 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 193/392] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:10 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:11.149195 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:11.150384 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:11.158269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:11.158713 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:11.159867 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:11.160005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:11.161655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:11.162563 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:11.170596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:11.171370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:11.172510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:11.173246 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:11.259233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-da358c17-d106-4ebf-ac95-aefe7ae4bf0b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 32921 microversion: 2.20 time: 0.115016 Aug 31 13:41:11.259977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 200/393] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:11 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 32921 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:11.384299 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:11.398457 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6b5adf5f-2bbb-4492-b8be-ff4a88560322 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.235585 Aug 31 13:41:11.399096 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 194/394] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:11 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:11.787550 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:11.788590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:11.795405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:11.795910 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:11.796679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:11.797129 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:11.946875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6927a5a9-421e-4a4b-afa5-071d84cfd535 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.163140 Aug 31 13:41:11.947532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 201/395] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:11 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:12.013207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:12.014145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:12.020609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.021058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.021821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.022250 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.157100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:12.165073 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-bb2ad399-9f3f-40a8-ac1e-0d9df0c0a296 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1314 microversion: 2.1 time: 0.155591 Aug 31 13:41:12.165660 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 195/396] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:12 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:12.272730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:12.273793 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:12.280770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.281225 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.282027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.282457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.415630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:12.416153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:12.422546 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.423001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.423792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.424228 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.450772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fcf417d7-18de-4271-adfe-1a16e25b243d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 33311 microversion: 2.20 time: 0.182232 Aug 31 13:41:12.451860 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 202/397] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:12 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 33311 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:12.564530 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:12.577892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fec98d1d-a132-44e5-b4c1-d30d19426f26 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.165668 Aug 31 13:41:12.578709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 196/398] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:12 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:12.961070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:12.962061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:12.968406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.968527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:12.969309 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:12.969922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.069712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-aa87b889-ad5d-461e-8e37-8f64a657c0f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.114499 Aug 31 13:41:13.070649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 203/399] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:12 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:13.182800 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:13.184034 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:13.190454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:13.190917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.191700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:13.192132 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.327317 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:13.336958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0f214677-4bb2-4f41-a891-c52d55cc61a6 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1497 microversion: 2.1 time: 0.157760 Aug 31 13:41:13.337583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 197/400] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:13 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:13.464901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:13.468176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:13.486769 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:13.487217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.488020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:13.488686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.598193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:13.598955 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:13.609822 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:13.609822 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.609822 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:13.609822 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:13.616988 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c6c6535b-09bd-4fc8-9a2a-da41a002dc62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 33706 microversion: 2.20 time: 0.156857 Aug 31 13:41:13.617968 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 204/401] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:13 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 33706 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:13.773200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:13.782168 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-23809df9-471b-467a-be01-2e4ff9d0b40c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.186508 Aug 31 13:41:13.783837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 198/402] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:13 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:14.082427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:14.083523 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:14.090653 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.091082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.091984 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.092437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.129606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:14.130095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:14.136429 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.136871 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.137638 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.138062 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.164035 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:41:14.192134 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7ef8233d-58cd-4472-bb91-89cad6a0ada3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.114319 Aug 31 13:41:14.193227 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 205/403] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:14 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:14.252794 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-40f0a2e5-1c48-40b2-aede-55eecd267bd7 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "DELETE /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 204 len: 0 microversion: 2.1 time: 0.127535 Aug 31 13:41:14.253469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 199/404] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:41:14 2021] DELETE /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 13:41:14.263344 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:14.264326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:14.272030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.272608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.273378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.273819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.402608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:14.410280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c67552ab-8321-4658-bfb1-26e2264d2f67 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1503 microversion: 2.1 time: 0.151266 Aug 31 13:41:14.410853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 206/405] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:14 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:14.630275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:14.631281 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:14.637962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.638528 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.640057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.640587 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.742864 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e69d8ab9-da43-4338-9e80-8c6cfcbfd891 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 34123 microversion: 2.20 time: 0.116501 Aug 31 13:41:14.747628 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 200/406] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:14 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 34123 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:14.799890 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:14.800737 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:14.807119 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.807799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.808677 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:14.809106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:14.950621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:14.958942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-29b4026b-1594-4a03-9ec0-fe9fbac559bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.162799 Aug 31 13:41:14.959277 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 207/407] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:14 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:15.206085 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:15.207215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:15.213570 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.214021 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.214793 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.215225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.311440 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f7cddc02-0e12-47a6-844b-be08afb8b2e9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.110564 Aug 31 13:41:15.313012 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 201/408] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:15 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:15.427860 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:15.428638 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:15.435234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.435718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.436831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.437266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.575459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:15.584465 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d0b05801-8493-4e33-9e9b-60d283ae3f1d tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1503 microversion: 2.1 time: 0.160180 Aug 31 13:41:15.585411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 208/409] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:15 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1503 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:15.756026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:15.757257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:15.764727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.765248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.766117 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.766653 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.898373 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a06e8c8a-ca10-4a51-827a-e9f5b8008298 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 34399 microversion: 2.20 time: 0.146331 Aug 31 13:41:15.899583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 202/410] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:15 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 34399 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:15.975685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:15.976300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:15.982673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.983254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:15.984301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:15.984782 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:16.135248 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:16.144358 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d90ed604-4791-4b0c-922d-37c1930a25f9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.172334 Aug 31 13:41:16.145649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 209/411] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:15 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:16.323367 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:16.324551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:16.332086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:16.332603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:16.333454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:16.333889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:16.454658 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7eff77c6-d65a-4e1d-886f-f9b17a33b7f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.135684 Aug 31 13:41:16.455215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 203/412] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:16 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:16.602784 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:16.603369 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:16.610806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:16.612665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:16.613443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:16.613948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:16.792862 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:16.802891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-69e2d945-5319-4277-afda-9ce6a871f207 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1503 microversion: 2.1 time: 0.203899 Aug 31 13:41:16.803979 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 210/413] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:16 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1503 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:16.913003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:16.914058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:16.921523 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:16.922050 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:16.922839 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:16.923600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.038228 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-45e0b4cd-f24b-4c75-b615-afc071fa3e37 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 34641 microversion: 2.20 time: 0.130237 Aug 31 13:41:17.039186 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 204/414] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:16 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 34641 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:17.165958 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:17.167134 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:17.174404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.174908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.175899 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.176579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.217228 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-6a8ed058-e467-44fb-80ff-dc66b461c81a req-59703577-e506-4be4-808d-78e0137d0e7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4ea845-2852-420f-845a-a97af7125ae0", "name": "network-vif-plugged", "status": "completed", "tag": "42ff9e47-16dd-4b52-a820-b31d0a17af0c"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:17.234103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:17.234103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:41:17.243500 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-6a8ed058-e467-44fb-80ff-dc66b461c81a req-59703577-e506-4be4-808d-78e0137d0e7d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.251096 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-6a8ed058-e467-44fb-80ff-dc66b461c81a req-59703577-e506-4be4-808d-78e0137d0e7d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.273138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-6a8ed058-e467-44fb-80ff-dc66b461c81a req-59703577-e506-4be4-808d-78e0137d0e7d service nova] Creating event network-vif-plugged:42ff9e47-16dd-4b52-a820-b31d0a17af0c for instance cf4ea845-2852-420f-845a-a97af7125ae0 on hv-cinder-80660 Aug 31 13:41:17.294103 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-6a8ed058-e467-44fb-80ff-dc66b461c81a req-59703577-e506-4be4-808d-78e0137d0e7d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081354 Aug 31 13:41:17.295325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 205/415] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:41:17.388216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:17.397284 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e66e9c7a-108a-42ba-a34e-6859b25a0d65 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.237603 Aug 31 13:41:17.406343 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 211/416] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:17 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:17.467755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:17.469493 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:17.478128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.478976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.481864 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.482676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.550664 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-97e54892-21d1-4e39-ba3e-badabbd8c334 req-86c90586-7890-4dc5-83d0-292b4f549b88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df25a5e6-7fd6-4319-a15c-bda6cf37b7d0", "name": "network-vif-deleted", "tag": "adbcec59-4752-42d2-a4d9-acc303306d91"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:17.554016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:41:17.554016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:41:17.565194 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-97e54892-21d1-4e39-ba3e-badabbd8c334 req-86c90586-7890-4dc5-83d0-292b4f549b88 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.565636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-97e54892-21d1-4e39-ba3e-badabbd8c334 req-86c90586-7890-4dc5-83d0-292b4f549b88 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.584595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f01b4550-d212-4f01-a846-c917c7ddf270 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 14 microversion: 2.1 time: 0.121054 Aug 31 13:41:17.584595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 206/417] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:17 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:17.585229 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-97e54892-21d1-4e39-ba3e-badabbd8c334 req-86c90586-7890-4dc5-83d0-292b4f549b88 service nova] Creating event network-vif-deleted:adbcec59-4752-42d2-a4d9-acc303306d91 for instance df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 on hv-cinder-80660 Aug 31 13:41:17.591067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-97e54892-21d1-4e39-ba3e-badabbd8c334 req-86c90586-7890-4dc5-83d0-292b4f549b88 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044912 Aug 31 13:41:17.591798 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 212/418] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:41:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:41:17.826294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:17.826988 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:17.833758 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.834209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.834971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.835417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.868421 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.868872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.869323 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lazy-loading 'fault' on Instance uuid df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:41:17.906193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:17.907380 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:17.914150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.914675 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.914854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:17.915471 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:17.915901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:17.922733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6bf6927e-87f3-45ff-9d56-d8a0f43a1bc0 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1304 microversion: 2.1 time: 0.100505 Aug 31 13:41:17.923326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 207/419] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:17 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:17.941147 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lazy-loading 'flavor' on Instance uuid 15246791-5821-4746-ab57-de3340921964 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:41:18.052566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:18.053424 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:18.059403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.059848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.060974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.061188 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.083974 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7f14148f-16e0-4937-8df2-a138877272e9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action" status: 200 len: 32 microversion: 2.1 time: 0.182096 Aug 31 13:41:18.084621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 213/420] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:17 2021] POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action => generated 32 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:18.094868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:18.095788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:18.102144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.102626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.103426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.103878 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.253752 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:18.262489 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-973f88af-dabe-4a4d-a23d-b011747daa6e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.171911 Aug 31 13:41:18.263079 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 214/421] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:18 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:18.420049 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:18.420836 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:18.427751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.428201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.429037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.429468 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.574802 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:18.587308 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c129255f-11af-4906-8a1e-9b6d15bb57b9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.173952 Aug 31 13:41:18.587917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 215/422] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:18 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:18.596992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:18.598009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:18.604277 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.604773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:18.605552 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:18.605972 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.323181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-32fb79f9-dee4-4306-8a7f-c6c667237719 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 6795 microversion: 2.1 time: 2.730616 Aug 31 13:41:21.323844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 216/423] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:18 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 6795 bytes in 2732 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:21.328767 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:21.329461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:21.335884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.336335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.337158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.337589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.362229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-06ab94af-29bb-49c3-934c-a300cd4bb412 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 36925 microversion: 2.20 time: 3.314289 Aug 31 13:41:21.365659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 208/424] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:18 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 36925 bytes in 3316 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:41:21.368080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:21.368800 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:21.369394 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.369849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.370516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lazy-loading 'fault' on Instance uuid df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:41:21.375126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.375578 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.381654 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.382083 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.456325 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'fbb73d40aa804f87aa1bf30a98ee35c7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c037b436492542b99cf63627ac6af982', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:21.463891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ee299106-4a21-4fd2-9549-aece617b51b4 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 200 len: 1304 microversion: 2.1 time: 0.139030 Aug 31 13:41:21.464567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 217/425] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:21 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 1304 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:21.468962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:21.469636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:21.479744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.480275 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.481016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:21.481442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:21.518207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:21.526398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3c1678a4-dd21-4987-ad77-cc6cdfbcafef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.161944 Aug 31 13:41:21.527119 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 209/426] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:21 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:21.692720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:21.706679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8e528726-7a59-49bd-90f5-b97f083aa743 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.240890 Aug 31 13:41:21.707564 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 218/427] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:21 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:22.334981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:22.336057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:22.343010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:22.343460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:22.344239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:22.344709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:22.375841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:22.376984 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:22.384172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:22.384645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:22.385429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:22.385885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.590718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ee24316e-7c3a-4dde-ab7d-bad6c4fc3918 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 17834 microversion: 2.1 time: 3.258968 Aug 31 13:41:25.591324 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 210/428] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:22 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 17834 bytes in 3261 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:25.597250 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:25.598265 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] [instance: df25a5e6-7fd6-4319-a15c-bda6cf37b7d0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:25.608281 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:25.608917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.610106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:25.610642 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.625779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] HTTP exception thrown: Instance df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 could not be found. Aug 31 13:41:25.626659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] Returning 404 to user: Instance df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:41:25.627418 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-572f8c0a-ab9e-47af-9240-2ba624558688 tempest-VolumesActionsTest-1364720248 tempest-VolumesActionsTest-1364720248-project] 10.222.0.21 "GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0" status: 404 len: 111 microversion: 2.1 time: 0.035131 Aug 31 13:41:25.628045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 211/429] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:25 2021] GET /compute/v2.1/servers/df25a5e6-7fd6-4319-a15c-bda6cf37b7d0 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:41:25.635047 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-670cbd69-08af-4466-a3c7-1e56c7f97ab6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 38138 microversion: 2.20 time: 3.260393 Aug 31 13:41:25.635596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:25.635596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:25.636159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 219/430] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:22 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 38138 bytes in 3266 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:25.641216 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:25.641526 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.642296 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:25.642426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:25.642730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.643149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:25.651875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:25.652311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.653172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:25.653607 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:25.787728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:25.798877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-59d544ea-920b-4de5-adc7-c61df1511b79 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.166702 Aug 31 13:41:25.798877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 212/431] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:25 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:25.808684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:25.815848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-214c83d1-99ee-4ac0-bc30-65fa2329f170 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1318 microversion: 2.1 time: 0.177211 Aug 31 13:41:25.816428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 220/432] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:25 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1318 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:26.602692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:26.603631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:26.610552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.610885 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.611667 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.612116 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.645207 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:26.646361 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:26.656057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.656741 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.658006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.658563 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.708463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a85199e3-a676-4672-ae01-2cd4f8652875 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 18069 microversion: 2.1 time: 0.109003 Aug 31 13:41:26.709444 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 213/433] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:26 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 18069 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:26.813554 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:26.814239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:26.821417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.821866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.822640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.823077 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.959282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:26.970366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cca04339-8f2d-4b74-92cc-8691b9d301f1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.160809 Aug 31 13:41:26.971196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 214/434] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:26 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:26.976106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:26.976768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:26.983124 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.983606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:26.984429 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:26.984864 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:27.119171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:27.127297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-96508904-51c5-48b7-8ea9-dac482a22583 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1509 microversion: 2.1 time: 0.154985 Aug 31 13:41:27.128478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 215/435] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:26 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:27.724064 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:27.725476 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:27.733289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:27.733734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:27.734516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:27.734950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:30.005048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e1a17543-4a1f-4480-8a98-e3d810ced52e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 200 len: 38281 microversion: 2.20 time: 3.365039 Aug 31 13:41:30.005748 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 221/436] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:26 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 38281 bytes in 3367 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:41:30.011059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:30.011746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:30.019201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:30.019644 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:30.020739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:30.021166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:30.074275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-08e8df90-a9a3-4d8c-a4c0-e27b30bd354d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 22792 microversion: 2.1 time: 2.354675 Aug 31 13:41:30.075163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 216/437] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:27 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 22792 bytes in 2357 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:30.080071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:30.080745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:30.088076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:30.088548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:30.089331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:30.089763 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:30.114386 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d21dc4a7-41f1-4246-a8f3-ea65ee6c3824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/ips" status: 200 len: 151 microversion: 2.20 time: 0.037996 Aug 31 13:41:30.114960 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 217/438] 10.222.0.21 () {60 vars in 1289 bytes} [Tue Aug 31 13:41:30 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:30.161537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:30.169856 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8f9e288e-738f-4e78-994e-d22f50213a0a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.162963 Aug 31 13:41:30.170463 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 222/439] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:30 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:31.087417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:31.088397 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:31.096256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:31.096749 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:31.097561 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:31.097998 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:31.187283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:31.187838 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:31.194571 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:31.195020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:31.196087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:31.196598 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:31.333575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:31.341549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-de006633-0ad7-4785-af7f-a3c680a51d67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.158123 Aug 31 13:41:31.342150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 223/440] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:31 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:32.361814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:32.362495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:32.370751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:32.371213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:32.372010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:32.372470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:32.510630 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:32.519565 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-38932027-9bf6-4dca-9678-b8e24dd4212d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.164297 Aug 31 13:41:32.520153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 224/441] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:32 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:33.540028 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:33.541091 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:33.547971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:33.548427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:33.549220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:33.549682 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:33.678976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:33.687112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-07f98687-eb8d-44ab-bef9-47fb9e240536 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.152627 Aug 31 13:41:33.687691 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 225/442] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:33 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:33.806011 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e037b0dc-ca4c-422c-8945-41699692b03b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 24421 microversion: 2.1 time: 2.723218 Aug 31 13:41:33.807153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 218/443] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:31 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 24421 bytes in 2726 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:34.711315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:34.712496 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:34.719014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:34.719445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:34.720451 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:34.720882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:34.826801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9735ad24-82f1-4ca9-b497-809a0405b9c7"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:34.826801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:34.831069 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:34.831644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:34.832750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:34.833301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:34.884132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:34.897042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f60cb2db-4662-4b27-91b1-bcc281741d8a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.196268 Aug 31 13:41:34.908110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 226/444] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:34 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:34.914057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:34.914992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:34.922744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:34.923556 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:34.924333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:34.924788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:35.031579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e8fcf564-e16b-4bfe-a3a5-9026439834ad tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 25075 microversion: 2.1 time: 0.121023 Aug 31 13:41:35.032230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 227/445] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:34 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 25075 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:35.138897 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-59711324-510d-432e-8a40-b70560fe2b1c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "POST /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.321582 Aug 31 13:41:35.139499 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 219/446] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:41:34 2021] POST /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 194 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:41:35.919829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:35.921492 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:35.932709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:35.933792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:35.935061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:35.935778 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:36.052428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:36.054370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:36.068349 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:36.069074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:36.070326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:36.071228 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:36.094388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:36.104849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4f366d55-02bb-4de1-92c4-d683b5828cee tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.192072 Aug 31 13:41:36.105793 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 228/447] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:35 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:36.225962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f0cf75c9-6e52-48bb-a909-d494e749789f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 25673 microversion: 2.1 time: 0.183212 Aug 31 13:41:36.226872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 220/448] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:36 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 25673 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:37.129457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:37.130876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:37.138018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.138653 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.139235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.139664 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.238028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:37.240266 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:37.249376 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.250518 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.253045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.253806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.286632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lazy-loading 'flavor' on Instance uuid 37ca962d-2198-4c40-ac9b-6ab316ebc725 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:41:37.401001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:37.409983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-58ee83d6-1cd7-437a-9100-f456b9bf7de4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.284820 Aug 31 13:41:37.410391 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 229/449] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:37 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:37.421795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:37.422983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:37.429421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.429862 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.430641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.431069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.581908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-51095a10-493d-4c1e-a8ff-9d31b485da1b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 26178 microversion: 2.1 time: 0.170082 Aug 31 13:41:37.583577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 230/450] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:37 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 26178 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:37.661597 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d72576dd-a006-4234-a07d-95f5ee29fe7e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 202 len: 0 microversion: 2.20 time: 0.452488 Aug 31 13:41:37.662152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 221/451] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:41:37 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 0 bytes in 454 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 13:41:37.673649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:37.674710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:37.682049 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.682909 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.683830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:37.684546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:37.843340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:37.853296 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:37.855402 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:37.856725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-97f2a437-9e06-41b1-8322-6984423b526d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.187953 Aug 31 13:41:37.857522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 231/452] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:37 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:38.438314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:38.440197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:38.454042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:38.455719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:38.457753 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:38.459444 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:38.594618 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:38.595638 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:38.599106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:38.601809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:38.602283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:38.603084 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:38.603510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:38.608128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d62dac1d-8e7b-4cee-b22b-d0c3300ee55f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.176677 Aug 31 13:41:38.608934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 222/453] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:38 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:38.718927 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0301a634-5f9b-490a-9aad-84343d2ab6f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 26676 microversion: 2.1 time: 0.127715 Aug 31 13:41:38.719759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 232/454] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:38 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 26676 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:38.875692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:38.876474 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:38.883449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:38.883891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:38.884727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:38.885189 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:39.040861 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:39.053552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:39.055061 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:39.056249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6ae61142-9bd6-4baa-9205-16aaf1deab4d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.184890 Aug 31 13:41:39.057016 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 223/455] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:38 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:39.626822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:39.628165 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:39.636214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:39.636969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:39.638110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:39.638864 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:39.731692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:39.733617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:39.746846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:39.747717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:39.749190 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:39.750905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:39.796679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:39.809976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b5bae8a0-615c-429e-8c30-2faaf5ceea02 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.187384 Aug 31 13:41:39.810982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 233/456] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:39 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:39.942791 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d318aca5-8443-4928-8809-025a7e54bcaf tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 27131 microversion: 2.1 time: 0.215400 Aug 31 13:41:39.948838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 224/457] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:39 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 27131 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:40.088336 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:40.089199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:40.103460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:40.104662 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:40.105537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:40.105977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:40.256537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:40.268345 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:40.270350 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:40.271784 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-686c4e10-2fab-4299-a5d8-99bc622bb9ce tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.194352 Aug 31 13:41:40.272608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 234/458] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:40 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:40.828822 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:40.830338 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:40.838186 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:40.839788 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:40.841048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:40.841725 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:40.957640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:40.959395 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:40.966972 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:40.967433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:40.968471 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:40.969050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:41.016055 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:41.027180 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0ed751e3-457e-4104-90af-bb04f8849439 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.202646 Aug 31 13:41:41.028037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 225/459] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:40 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:41.094798 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f8908b9e-64c9-47d3-8253-c7838baaaedd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 27538 microversion: 2.1 time: 0.142817 Aug 31 13:41:41.099738 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 235/460] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:40 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 27538 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:41.196184 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "744129b3-0c67-49ce-b296-9b265253d099", "device": "/dev/sdb"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:41.198399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:41.205454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:41.205918 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:41.206745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:41.207174 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:41.291389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:41.292139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:41.299760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:41.300423 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:41.301557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:41.301996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:41.448729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:41.458991 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:41.466160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:41.468121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c2c685d9-13f6-4566-a2e3-3cb65472379b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.181001 Aug 31 13:41:41.479594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 236/461] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:41 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:41.555000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7f00a6c3-7dd4-4a0c-a60c-03da517caa89 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "POST /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.363619 Aug 31 13:41:41.556627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 226/462] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:41:41 2021] POST /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da/os-volume_attachments => generated 194 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:42.045592 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:42.046943 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:42.054068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:42.055015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:42.056064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:42.056805 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:42.108740 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:42.110086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:42.118434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:42.119044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:42.120238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:42.120832 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:42.248293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:42.257624 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-56fb7b1d-0c27-428e-9ae7-88e3a7686aa8 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.216750 Aug 31 13:41:42.258638 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 237/463] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:42 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:42.273679 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-76a8010a-7990-4c0a-ab30-5c9a7ae4fe5f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 27701 microversion: 2.1 time: 0.169514 Aug 31 13:41:42.275573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 227/464] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:42 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 27701 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:42.487616 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:42.488209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:42.495273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:42.495854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:42.496687 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:42.497290 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:42.643181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:42.655070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:42.656663 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:42.657825 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3d3c1275-7552-4bfa-8562-64c7869e701a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.174768 Aug 31 13:41:42.658559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 238/465] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:42 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:43.279028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:43.279825 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:43.288217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:43.289566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:43.289918 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:43.290056 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:43.290893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:43.291526 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:43.299003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:43.299631 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:43.300507 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:43.301004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:43.419411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f3efded0-92bd-4ce7-add4-14a36f759c8c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 27874 microversion: 2.1 time: 0.135384 Aug 31 13:41:43.420082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 239/466] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:43 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 27874 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:41:43.442546 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:43.451278 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-52392a1d-1aa5-4e6f-b8a2-18f912cb1a4e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.178127 Aug 31 13:41:43.451970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 228/467] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:43 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:43.679033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:43.680165 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:43.689291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:43.690021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:43.690729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:43.691241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:43.884554 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:43.897353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:43.899266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:43.901495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-02099a91-3946-4044-9f83-ff5010fa67f6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.227291 Aug 31 13:41:43.903546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 240/468] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:43 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:44.073435 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:44.073854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:44.080610 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.081075 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.081866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.082334 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.204120 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'services' on Instance uuid cf4ea845-2852-420f-845a-a97af7125ae0 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:41:44.288260 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-57e924dc-2ef9-433b-bf53-ea6a31b06f2f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments/9735ad24-82f1-4ca9-b497-809a0405b9c7" status: 202 len: 0 microversion: 2.1 time: 0.218853 Aug 31 13:41:44.289113 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 229/469] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:41:44 2021] DELETE /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments/9735ad24-82f1-4ca9-b497-809a0405b9c7 => generated 0 bytes in 221 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:41:44.298571 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:44.300357 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:44.307522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.307993 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.309073 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.309672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.362121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-704604eb-fe1f-4aea-823c-e0f49ad6ff4d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067545 Aug 31 13:41:44.363251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 241/470] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:44 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:44.431692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:44.433200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:44.441575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.442334 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.443298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.443961 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.470726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:44.471677 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:44.478475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.481359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.482375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.482955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.559569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2a92a69c-6118-4786-9723-5b1cf7260b02 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 27988 microversion: 2.1 time: 0.131727 Aug 31 13:41:44.560228 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 230/471] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:44 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 27988 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:44.639996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:44.648887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-393fbb43-b987-48fb-8111-28a015cef0d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.181867 Aug 31 13:41:44.649703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 242/472] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:44 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:44.924002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:44.924770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:44.935324 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.936111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:44.937112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:44.937644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.094152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:45.102761 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:45.104504 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:45.105640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4893f973-526f-4adc-b0f9-b143f9abaa24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.186411 Aug 31 13:41:45.106434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 231/473] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:44 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:45.375344 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:45.376218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:45.383080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:45.384107 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.385202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:45.385671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.419865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-69e463bb-d8c2-4a52-ad19-096b95cf8397 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048443 Aug 31 13:41:45.421092 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 243/474] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:45 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:45.577903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:45.578828 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:45.586367 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:45.587195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.588334 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:45.588885 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.667307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:45.668733 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:45.675949 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:45.676524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.677355 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:45.677786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:45.707568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-08b1b558-96f4-4ea9-b13b-fb60fe043b9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.132957 Aug 31 13:41:45.714726 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 232/475] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:45 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:45.820609 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:45.830702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1d34f318-7c81-4e22-ad76-2e8b6a7e7853 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.168310 Aug 31 13:41:45.831783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 244/476] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:45 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:46.124269 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:46.124991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:46.132672 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.133114 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.134216 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.134859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.271230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:46.279769 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:46.281540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:46.282693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d4d784c8-f080-4069-b420-24fb81ef3991 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.162795 Aug 31 13:41:46.283248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 233/477] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:46 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:46.431604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:46.432914 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:46.439407 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.439858 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.440685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.441172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.474507 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2bec03ea-46a4-4ce3-b215-8db426ba68ff tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046767 Aug 31 13:41:46.478328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 245/478] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:46 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:46.722154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:46.723838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:46.731121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.731786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.733022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.733483 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.834030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-baf0e874-d052-4a8b-99d0-863377919013 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.115372 Aug 31 13:41:46.834934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 234/479] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:46 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:46.849128 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:46.850055 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:46.856871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.857292 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:46.858389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:46.859160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.003801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:47.013229 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-905e3c46-3aa2-4493-936b-14c5cc4b8a08 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.168280 Aug 31 13:41:47.031022 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 246/480] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:46 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:47.303758 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:47.304975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:47.318989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:47.320180 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.321411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:47.322109 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.480832 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:47.487876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:47.491015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:47.498083 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:47.498932 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.499569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:47.499847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:47.500359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.502760 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:47.504005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-99a127be-8189-4c21-a4e5-bab0c464f229 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.205615 Aug 31 13:41:47.505230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 235/481] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:47 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:47.561466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0c07bc9c-84e5-4522-9dad-c8ec1b871e0d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078615 Aug 31 13:41:47.564421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 247/482] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:47 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:47.846276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:47.847137 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:47.853510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:47.854229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.855148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:47.855754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:47.943761 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1f6e979a-b53b-4dff-b198-ed1d4ae88287 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.100892 Aug 31 13:41:47.945071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 236/483] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:47 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:48.031347 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:48.032086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:48.060467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.061010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.062009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.062274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.259696 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:48.270006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-eaa6eba0-2a09-4997-b877-1a821f958d34 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.242954 Aug 31 13:41:48.270585 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 248/484] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:48 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:48.526818 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:48.527506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:48.534739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.535536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.536613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.537237 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.573325 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:48.574412 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:48.592211 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.592690 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.593695 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.594132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.634868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-12743ade-e43f-453e-8796-80a542d7d379 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065543 Aug 31 13:41:48.639965 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 249/485] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:48 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:41:48.709443 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:48.721640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:48.723610 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:48.725029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f7cfe63d-4306-487a-9113-471e1975e109 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.202594 Aug 31 13:41:48.726254 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 237/486] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:48 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:41:48.957845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:48.959603 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:48.969322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.970185 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:48.970971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:48.971410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.096954 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c728a464-5f12-48b3-8019-c0aef726a107 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.143240 Aug 31 13:41:49.106457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 250/487] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:48 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:49.287205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:49.288682 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:49.295915 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:49.296594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.297476 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:49.298037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.430426 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:49.438648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-67505094-962b-4958-8c13-9bf0bc648b76 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.155442 Aug 31 13:41:49.439306 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 238/488] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:49 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:49.648837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:49.650052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:49.658281 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:49.658850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.659680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:49.660432 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.708409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-50f34e15-40be-4e59-a5b5-945a70908baa tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064262 Aug 31 13:41:49.708980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 251/489] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:49 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:49.745026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:49.745971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:49.752729 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:49.753202 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.753986 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:49.754677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:49.892447 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:49.901946 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:49.903458 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:49.904744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a3c956e6-6dce-4c8c-88f5-b73fedd0136d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.164094 Aug 31 13:41:49.905300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 239/490] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:49 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:50.112364 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:50.113492 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:50.120318 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.121025 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.121860 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.122264 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.283301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b1ce85ca-a631-4d70-91fc-334fc84002f7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.174986 Aug 31 13:41:50.284144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 252/491] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:50 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:41:50.457931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:50.460033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:50.484005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.484484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.485516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.486294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.634186 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:50.642760 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c59c4ce4-945c-4382-ba9e-4d29b6c8f8d9 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.190307 Aug 31 13:41:50.643375 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 240/492] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:50 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:50.721932 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:50.723733 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:50.730485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.730930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.731906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.732525 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.768051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0d3d66ba-f5ce-40ca-8986-39f755def191 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050370 Aug 31 13:41:50.768590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 253/493] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:50 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:50.923373 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:50.923987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:50.930412 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.930860 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:50.931647 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:50.932123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.157814 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:51.168102 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:51.169790 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:51.171185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a1079a05-379f-4435-a125-8a358bef38a7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.251888 Aug 31 13:41:51.172076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 241/494] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:50 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:51.295928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:51.297337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:51.303289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:51.303803 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.304820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:51.305430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.660811 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:51.661566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:51.668251 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:51.668843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.669643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:51.670321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.812950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:51.823244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d6bdd452-5300-4850-9611-f58c92067ae5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.165698 Aug 31 13:41:51.832759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 242/495] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:51 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:51.832759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:51.832759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:51.836268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:51.836745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.837540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:51.837975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:51.869413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-da8b220c-48d3-402c-95b7-bbf47af1aa04 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043997 Aug 31 13:41:51.870212 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 243/496] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:51 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:52.190174 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:52.190781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:52.199029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:52.199795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:52.200245 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:52.200717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:52.343301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:52.352038 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:52.354106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:52.356617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-834a9f23-e0ec-4b97-a2e1-34fcfc4194ad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.170240 Aug 31 13:41:52.358802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 244/497] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:52 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:41:52.841526 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:52.842178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:52.848820 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:52.849521 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:52.850322 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:52.850755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:52.983874 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:52.994227 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c876c966-ab51-4441-aa78-230173ac1239 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.156403 Aug 31 13:41:52.995140 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 245/498] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:52 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:53.002018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:53.004893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:53.012571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:53.013044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:53.013865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:53.014287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:53.056337 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2e226769-1370-4433-86af-cb647f06414c tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060088 Aug 31 13:41:53.057376 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 246/499] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:52 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:53.378191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:53.378809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:53.385354 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:53.385817 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:53.386577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:53.387008 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:53.522061 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:53.531412 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:53.532954 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:53.534146 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7f5c87a7-bb32-4145-9463-9cd6e497f621 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.162556 Aug 31 13:41:53.544480 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 247/500] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:53 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:54.015820 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:54.018261 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:54.029747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:54.030870 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:54.032509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:54.033331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:54.211436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:54.221712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2c1b2e07-21de-4a0f-b13e-a184288f3ba5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.213758 Aug 31 13:41:54.222302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 248/501] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:54 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:41:54.227728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:54.228632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:54.238596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:54.239045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:54.240077 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:54.240295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:54.284197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1f02f037-3072-4102-9dfc-d930599d420d tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060660 Aug 31 13:41:54.288831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 249/502] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:54 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:41:54.449060 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a4e5389e-2dc2-4065-9b24-f6f49da5842d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 3.156983 Aug 31 13:41:54.449984 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 254/503] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:51 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 3159 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:54.558633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:54.559329 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:54.567026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:54.567576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:54.568608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:54.569044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:54.743813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:54.757074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:54.759065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:54.760665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-99905196-b979-4627-8279-49e08584d6b6 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.206040 Aug 31 13:41:54.761623 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 250/504] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:54 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:55.244754 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:55.245435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:55.253842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.254418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.255615 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.256183 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.297279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:55.298253 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:55.306613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.307205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.308022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.308541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.342356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c0b219c9-0d35-4aa4-8443-6c26deb0e8ab tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049069 Aug 31 13:41:55.343178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 251/505] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:41:55 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:41:55.422739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:55.439321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-29a2ab57-edb7-4ac6-9c6b-f47f62aee699 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.197496 Aug 31 13:41:55.439964 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 255/506] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:55 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:55.461134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:55.462087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:55.468399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.468843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.469635 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.470068 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.583095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8767330b-789e-4948-ad9c-40b52101b86a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.125558 Aug 31 13:41:55.583902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 252/507] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:55 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:55.779599 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:55.780228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:55.788057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.788357 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.789254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:55.789706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:55.942006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:55.950706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:55.952218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:55.953411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d263129e-1e66-44a0-abd2-e8721fc33688 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.178078 Aug 31 13:41:55.953971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 256/508] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:55 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:56.458060 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:56.458856 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:56.466637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.467100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.467896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.468330 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.572465 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:56.573291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:56.579830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.580336 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.581228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.581719 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.605630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:56.610404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:41:56.613886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-24195c24-f22d-42f3-bd7c-8685348fa15f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.160150 Aug 31 13:41:56.614461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 253/509] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:56 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:56.619703 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:41:56.620636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:56.627010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.627452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.628217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.628665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.700411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3a31fe73-146b-443b-a59b-8a844fb53104 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 204 len: 0 microversion: 2.1 time: 0.131448 Aug 31 13:41:56.701403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 257/510] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:41:56 2021] DELETE /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:41:56.709726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:56.710419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:56.716865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.717313 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.718134 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.718693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.851672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:56.860245 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8b924ad9-434b-4ca0-84dd-63d77d4881eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.154515 Aug 31 13:41:56.860886 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 258/511] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:56 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:56.976871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:56.976871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:56.982476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.982915 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:56.983720 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:56.984139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:57.116643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:57.125647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:57.127289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:57.128565 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8eec609c-6c7b-4025-9cc5-506013cda3ba tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.160159 Aug 31 13:41:57.129133 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 259/512] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:56 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:57.634849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:57.635376 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:57.641781 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:57.642318 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:57.643203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:57.643761 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:57.774588 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:57.783269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d9a32a4f-5a54-4cad-a2e8-2270056919d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.155275 Aug 31 13:41:57.783855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 260/513] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:57 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:57.880652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:57.881868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:57.890221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:57.890667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:57.891440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:57.891897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:58.029286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:58.038350 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-dc69ee10-b552-4e31-80b6-e36d30429ab4 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.163403 Aug 31 13:41:58.038946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 261/514] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:57 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:58.152176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:58.152802 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:58.159220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:58.159652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:58.160440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:58.160862 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:58.305491 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:58.313621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:58.315127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:58.316294 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-72e91eca-1b88-4988-91bc-0d0a9d39dfec tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.170533 Aug 31 13:41:58.316884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 262/515] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:58 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:58.800921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:58.801421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:58.808687 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:58.809127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:58.809881 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:58.810306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:58.945039 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:58.953009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-05907a90-9b2a-46bb-8a68-bfca9424618b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.155967 Aug 31 13:41:58.953583 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 263/516] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:58 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:59.060422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:59.060961 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:59.068752 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:59.069335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:59.070405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:59.070996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:59.434084 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:59.444876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6dd70abb-1f33-4535-bfa8-e1bcefb08570 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.389900 Aug 31 13:41:59.445514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 264/517] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:59 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:41:59.451055 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:59.451661 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:59.458385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:59.458822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:59.459591 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:59.459996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:59.590349 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:59.605820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:59.607379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:41:59.608626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b1670f97-97c0-48e2-85ed-433e299e1718 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.162055 Aug 31 13:41:59.609202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 265/518] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:41:59 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:41:59.832209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6366aca6-932b-4d53-9939-dfd308f176a1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 3.215812 Aug 31 13:41:59.833082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 254/519] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:41:56 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 3218 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:41:59.970416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:41:59.971054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:41:59.977624 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:59.978024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:41:59.978781 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:41:59.979586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.111291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:00.119536 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-11af55ef-572e-4098-85e4-94745907ac67 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.152903 Aug 31 13:42:00.120406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 266/520] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:41:59 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:00.462825 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:00.463516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:00.471879 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:00.472558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.473434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:00.473926 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.608616 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:00.616627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5aa643be-af0e-48ce-9c3d-3cd777ddd8fc tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.157713 Aug 31 13:42:00.620854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 255/521] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:00 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:00.630653 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:00.631292 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:00.638329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:00.638789 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.639570 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:00.640078 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.844640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:00.845611 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:00.851993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:00.852432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.853235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:00.853666 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:00.869401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:00.881929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:00.881929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:00.881929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8c87243a-9052-4ca3-a123-2acb0fc0598f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.253260 Aug 31 13:42:00.889147 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 267/522] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:00 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:00.934383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5bfc6170-a3cf-4c4d-88be-c70ba5790124 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.093318 Aug 31 13:42:00.935160 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 256/523] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:00 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:01.142490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:01.143111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:01.149125 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.149573 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.150360 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.150790 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.284514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:01.303011 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-afe4f427-63d3-4d02-b68d-9d13cec1a4c6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.164187 Aug 31 13:42:01.313144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 268/524] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:01 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:01.639066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:01.640285 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:01.648169 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.648743 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.649589 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.650091 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.781389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:01.788887 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ab0ec330-b65f-4006-8ed3-51e1cebf4005 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.157755 Aug 31 13:42:01.789553 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 257/525] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:01 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:01.899251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:01.900895 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:01.907994 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.908487 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.909491 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.910032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.947128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:01.948492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:01.955184 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.955711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:01.956628 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:01.957128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:02.040336 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:02.051442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:02.053180 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:02.054745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bdf477c3-7ba6-4fc4-9950-6b9c179e1594 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.159465 Aug 31 13:42:02.055536 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 269/526] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:01 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:02.320087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:02.320777 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:02.326947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:02.327405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:02.328183 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:02.328618 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:02.479986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:02.489299 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2f9c96a6-2b3a-47dd-b487-d73e7950a2a1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.172721 Aug 31 13:42:02.490031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 270/527] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:02 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:02.807739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:02.808440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:02.815830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:02.816276 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:02.817383 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:02.817870 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:02.966434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:02.974419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7dc3c930-9f69-4cac-8868-1b26e432ce36 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.170825 Aug 31 13:42:02.975655 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 271/528] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:02 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:03.077703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:03.078303 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:03.086089 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:03.086562 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:03.087736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:03.088421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:03.233625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:03.242571 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:03.244073 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:03.245247 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e8670762-dc8d-4b53-a31a-4195f3b4d4e0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.172264 Aug 31 13:42:03.245830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 272/529] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:03 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:03.506899 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:03.507614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:03.514863 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:03.515334 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:03.516064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:03.516529 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:03.649162 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:03.659033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-10222f7a-156d-4e81-af2e-2932a86e278d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.155864 Aug 31 13:42:03.659627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 273/530] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:03 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:03.999210 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:04.000092 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:04.006635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:04.007080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:04.007883 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:04.008324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:04.150158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:04.158201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b3bd5aca-7ff4-47dd-a5c0-8746672c00a7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.162934 Aug 31 13:42:04.158778 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 274/531] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:03 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:04.271331 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:04.272181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:04.280174 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:04.280676 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:04.281437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:04.281928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:04.421474 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:04.432829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:04.435269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:04.437117 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a3a43f42-bc53-40a1-8012-8fd9408464c0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.171163 Aug 31 13:42:04.437866 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 275/532] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:04 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:04.611240 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3b2e2e2b-ae93-4d88-b212-166cafea5139 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 2.669101 Aug 31 13:42:04.612648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 258/533] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:01 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 2672 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:42:04.679926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:04.680497 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:04.687960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:04.688402 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:04.689246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:04.689680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:04.895689 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:04.904974 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0acf2e10-b9ad-4ced-be51-5b78bf217dba tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.230713 Aug 31 13:42:04.905598 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 276/534] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:04 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:05.175847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:05.176562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:05.183704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.184420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.185303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.185676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.319747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:05.327691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f5371d87-0a0b-45af-baf8-1c95ef455527 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1515 microversion: 2.1 time: 0.155891 Aug 31 13:42:05.328363 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 259/535] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:05 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:05.494746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:05.495246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:05.501142 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.501584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.502335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.502765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.623027 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:05.624288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:05.631067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.631875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.633457 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.634407 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.653856 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:05.663064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:05.664562 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:05.665735 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2bb46924-c3c1-4480-a00a-c441ad4e45b7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.174928 Aug 31 13:42:05.666309 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 277/536] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:05 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:05.725422 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-547a0a84-5bc5-4d95-931b-5c9ffc4e8d05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28236 microversion: 2.1 time: 0.106130 Aug 31 13:42:05.729105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 260/537] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:05 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28236 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:05.922590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:05.923199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:05.929448 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.929884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:05.930680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:05.931105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.150347 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:06.160326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-07f496a8-c1bc-4015-98c5-45b95824da71 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.241677 Aug 31 13:42:06.161151 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 278/538] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:05 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:06.303844 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-1055e6be-c81b-413e-9b48-5a86c5545977 req-62a12552-aa20-4853-88b2-2dab5284cfe2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cf4ea845-2852-420f-845a-a97af7125ae0", "name": "network-vif-deleted", "tag": "42ff9e47-16dd-4b52-a820-b31d0a17af0c"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:06.306230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:06.306230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:42:06.317220 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-1055e6be-c81b-413e-9b48-5a86c5545977 req-62a12552-aa20-4853-88b2-2dab5284cfe2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.317769 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-1055e6be-c81b-413e-9b48-5a86c5545977 req-62a12552-aa20-4853-88b2-2dab5284cfe2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.332631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-1055e6be-c81b-413e-9b48-5a86c5545977 req-62a12552-aa20-4853-88b2-2dab5284cfe2 service nova] Creating event network-vif-deleted:42ff9e47-16dd-4b52-a820-b31d0a17af0c for instance cf4ea845-2852-420f-845a-a97af7125ae0 on hv-cinder-80660 Aug 31 13:42:06.341022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-1055e6be-c81b-413e-9b48-5a86c5545977 req-62a12552-aa20-4853-88b2-2dab5284cfe2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041598 Aug 31 13:42:06.341523 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 261/539] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:42:06.348062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:06.348845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:06.366895 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.367728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.374390 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.375112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.447470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:06.455443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8b0b766e-f8d7-4b88-a6fd-b722e5a06b28 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1303 microversion: 2.1 time: 0.114473 Aug 31 13:42:06.456021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 279/540] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:06 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:06.685111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:06.685840 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:06.693035 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.693530 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.694348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.694802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.737563 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:06.744154 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:06.750212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.750739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.752129 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:06.752884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:06.827122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:06.840002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:06.841617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:06.842795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-21d66431-0cb7-4a44-9b5a-16ebe9750693 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1744 microversion: 2.20 time: 0.162118 Aug 31 13:42:06.843438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 262/541] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:06 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1744 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:07.179033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:07.179784 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:07.187101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.187559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:07.188332 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.188796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:07.320700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:07.334121 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f593b1bd-0a8e-44ff-a32f-5b3ac9476a27 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.159626 Aug 31 13:42:07.334692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 263/542] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:07 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:07.472421 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:07.473045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:07.481149 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.481589 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:07.482343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.482764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:07.514813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.515267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:07.515687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'fault' on Instance uuid cf4ea845-2852-420f-845a-a97af7125ae0 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:07.557811 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:07.569544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-594b8ca6-4370-424f-9e0d-6cc0a7205531 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1308 microversion: 2.1 time: 0.100581 Aug 31 13:42:07.570403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 264/543] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:07 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1308 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:07.865337 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:07.866089 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:07.873995 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.874471 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:07.875240 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:07.875676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:08.015614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:08.032162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:08.035193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:08.037147 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c5dd2765-630c-4e31-a626-c5f6646c8357 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1744 microversion: 2.20 time: 0.177989 Aug 31 13:42:08.037710 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 265/544] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:07 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1744 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:08.352238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:08.352869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:08.359601 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:08.360050 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:08.360869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:08.361277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:08.494037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:08.502142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-39def7de-55c2-4f29-bf30-8b5a708c33d2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.153786 Aug 31 13:42:08.502726 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 266/545] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:08 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:08.592009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:08.592667 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:08.599264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:08.599728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:08.600533 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:08.600969 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:08.632609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:08.633053 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:08.633502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'fault' on Instance uuid cf4ea845-2852-420f-845a-a97af7125ae0 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:08.677081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:08.684612 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c300b431-fc2b-413a-850e-7435c96cc259 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1308 microversion: 2.1 time: 0.099932 Aug 31 13:42:08.685152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 267/546] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:08 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1308 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:09.055264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:09.055951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:09.062535 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.063003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.063789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.064217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.201944 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:09.209916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:09.211426 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:09.212585 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b8180501-5444-46fa-96b0-3e039d10ae30 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1744 microversion: 2.20 time: 0.161255 Aug 31 13:42:09.213181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 268/547] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:09 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:09.522889 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:09.523903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:09.530950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.531393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.532175 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.532629 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.668565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:09.676779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-18270fa6-5599-43e7-b2cf-ac7d84be7b14 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.157501 Aug 31 13:42:09.677383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 269/548] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:09 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:09.700356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:09.701175 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:09.707315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.707757 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.708632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.709084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.742775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:09.743210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:09.743650 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'fault' on Instance uuid cf4ea845-2852-420f-845a-a97af7125ae0 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:09.786489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:09.794994 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2d3b6d45-7445-44ef-8ea3-cadd43e6becd tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 200 len: 1308 microversion: 2.1 time: 0.098377 Aug 31 13:42:09.795632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 270/549] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:09 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 1308 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:10.234567 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:10.235287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:10.237660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-03f7071d-7ff1-4a58-87b6-f01a66b5d34b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28527 microversion: 2.1 time: 3.502724 Aug 31 13:42:10.239191 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 280/550] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:06 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28527 bytes in 3506 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:10.243268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:10.243721 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:10.245133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:10.245572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:10.582704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:10.591875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:10.594209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:10.595534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4b04126e-3cb4-43ab-9f3e-30d8d39009d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1744 microversion: 2.20 time: 0.367155 Aug 31 13:42:10.596074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 271/551] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:10 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1744 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:10.695102 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:10.695818 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:10.703418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:10.703922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:10.704854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:10.705295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:10.811256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:10.811865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: cf4ea845-2852-420f-845a-a97af7125ae0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:10.818082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:10.818612 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:10.819263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:10.819694 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:10.836121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:10.836478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] HTTP exception thrown: Instance cf4ea845-2852-420f-845a-a97af7125ae0 could not be found. Aug 31 13:42:10.836887 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Returning 404 to user: Instance cf4ea845-2852-420f-845a-a97af7125ae0 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:10.837766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c580a681-9253-44bf-8bee-430ed3c3e75f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0" status: 404 len: 111 microversion: 2.1 time: 0.030621 Aug 31 13:42:10.838314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 272/552] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:10 2021] GET /compute/v2.1/servers/cf4ea845-2852-420f-845a-a97af7125ae0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:42:10.846121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a554c775-8c00-4c9d-aa54-6b664cff037c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.155064 Aug 31 13:42:10.846773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 281/553] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:10 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:11.249484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:11.250460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:11.257023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:11.257455 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:11.258261 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:11.259005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:11.327209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-70814505-79a8-4b64-9c3f-bfbe04ec02de tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28527 microversion: 2.1 time: 0.081156 Aug 31 13:42:11.328002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 273/554] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:11 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28527 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:11.613802 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:11.614503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:11.622385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:11.623346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:11.624584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:11.625193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:11.798478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:11.809775 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:11.822240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:11.823601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6921cd18-815c-405b-b989-b22237faf1c3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.213543 Aug 31 13:42:11.824496 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 282/555] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:11 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:11.864183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:11.864962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:11.877953 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:11.878699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:11.879492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:11.879977 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:11.999466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:12.000231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:12.020477 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.021099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.021976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.022406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.067845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:42:12.077632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:12.086576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5f4d021a-7cdb-4173-a803-e2a8119c5b6b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.226613 Aug 31 13:42:12.088041 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 274/556] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:11 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:12.185262 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0df38022-3cc8-44c6-a76c-23c380665705 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 204 len: 0 microversion: 2.1 time: 0.189911 Aug 31 13:42:12.186773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 283/557] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:42:11 2021] DELETE /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:12.197305 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:12.198364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:12.207009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.207912 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.210801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.211637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.346425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:12.348517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:12.364558 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.365303 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.366459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.367111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.440186 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:12.453455 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8c02fa2b-a3d0-48e6-834b-68f7a0590b8f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1514 microversion: 2.1 time: 0.262222 Aug 31 13:42:12.454082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 275/558] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:12 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1514 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:12.502325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-7e98ada6-4f91-4b36-ae5b-74f41b331c5c req-26e60195-e6bc-4c1c-9d65-2ec2c9fc6a59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "name": "network-vif-plugged", "status": "completed", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:12.504560 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:12.504560 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:42:12.512793 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-7e98ada6-4f91-4b36-ae5b-74f41b331c5c req-26e60195-e6bc-4c1c-9d65-2ec2c9fc6a59 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.513496 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-7e98ada6-4f91-4b36-ae5b-74f41b331c5c req-26e60195-e6bc-4c1c-9d65-2ec2c9fc6a59 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.525532 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-7e98ada6-4f91-4b36-ae5b-74f41b331c5c req-26e60195-e6bc-4c1c-9d65-2ec2c9fc6a59 service nova] Creating event network-vif-plugged:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:42:12.531326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-7e98ada6-4f91-4b36-ae5b-74f41b331c5c req-26e60195-e6bc-4c1c-9d65-2ec2c9fc6a59 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032951 Aug 31 13:42:12.532164 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 276/559] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:12 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:42:12.701636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:12.702614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:12.709490 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.709942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.710708 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.711355 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.750286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a5494398-4b5a-481c-9aab-6e39afb74d4e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.409953 Aug 31 13:42:12.752463 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 284/560] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:12 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:12.850009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:12.850610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:12.864575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lazy-loading 'services' on Instance uuid fb6ec340-96e6-4018-933b-e3b1623e65da {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:12.871673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.872692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.874450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:12.875217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:12.947956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7c034b4e-7784-4bb2-aa5a-34f7c3b01189 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da/os-volume_attachments/744129b3-0c67-49ce-b296-9b265253d099" status: 202 len: 0 microversion: 2.1 time: 0.250555 Aug 31 13:42:12.948701 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 277/561] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:42:12 2021] DELETE /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da/os-volume_attachments/744129b3-0c67-49ce-b296-9b265253d099 => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:42:13.023955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:13.033902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:13.035954 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:13.037458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5137dca0-9df8-4ebf-ad0d-31539ddeda62 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.198013 Aug 31 13:42:13.037915 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 285/562] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:12 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:13.111235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:13.111945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:13.120785 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:13.121516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:13.122579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:13.123728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:13.287495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:13.297122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-81b381c0-349f-45c5-a038-181086583f54 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1569 microversion: 2.1 time: 0.192123 Aug 31 13:42:13.298053 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 278/563] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:13 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1569 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:13.471113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:13.471722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:13.478033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:13.478746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:13.479701 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:13.480305 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:13.628790 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:13.637103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7d2317d6-23a7-42df-85a1-f9270485ed6a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1514 microversion: 2.1 time: 0.169693 Aug 31 13:42:13.638337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 286/564] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:13 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:13.772205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:13.773519 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:13.780992 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:13.781698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:13.782762 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:13.783440 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:13.907125 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7ac5fd6d-0b0d-442f-8d97-41d4a7d7a396 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.125395 Aug 31 13:42:13.908476 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 279/565] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:13 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:14.063098 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:14.063998 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.074457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.083584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.084913 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.085579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.317941 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:14.318666 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.335382 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.335837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.336687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.337118 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.339071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:14.354085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:14.355639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:14.356874 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c1406fa3-e071-4f74-b7d8-e703bee5eca8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.299262 Aug 31 13:42:14.361102 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 287/566] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:14 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:14.491085 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:14.502626 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-afe80d6e-d1dd-4cb6-8bc6-db1355e271f2 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1549 microversion: 2.1 time: 0.189283 Aug 31 13:42:14.503234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 280/567] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:14 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1549 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:14.523124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:14.524057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.534694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.535404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.536410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.537005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.667721 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:14.668794 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.673263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] HTTP exception thrown: Cannot 'detach_volume' instance 15246791-5821-4746-ab57-de3340921964 while it is in vm_state rescued Aug 31 13:42:14.674067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Returning 409 to user: Cannot 'detach_volume' instance 15246791-5821-4746-ab57-de3340921964 while it is in vm_state rescued {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:14.674958 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2249b6d9-3ce5-4134-9bea-cbc0fac3f3f5 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "DELETE /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments/721c28e7-b3d1-4dcc-9cac-b7b2a687eedd" status: 409 len: 152 microversion: 2.1 time: 0.155816 Aug 31 13:42:14.677670 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 288/568] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:42:14 2021] DELETE /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments/721c28e7-b3d1-4dcc-9cac-b7b2a687eedd => generated 152 bytes in 159 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 31 13:42:14.683836 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:14.684058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.684573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.684971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.685504 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.686064 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.691727 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.692495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.693494 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.694095 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.799094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e438c2e2-de08-42ec-bca8-86f5bc4c2914 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action" status: 202 len: 0 microversion: 2.1 time: 0.118456 Aug 31 13:42:14.800121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 289/569] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:14 2021] POST /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:42:14.809279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:14.812892 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.821237 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.822063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.823063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.823682 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.892487 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:14.902124 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8587929a-7e5d-4701-bdaa-2675d2ca0fa2 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1514 microversion: 2.1 time: 0.250844 Aug 31 13:42:14.916827 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 281/570] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:14 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1514 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:14.931242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:14.932167 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:14.958435 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.959220 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:14.961698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:14.963355 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.072217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:15.098573 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2b71148d-fb2f-46b7-8f22-29c412138d12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1557 microversion: 2.1 time: 0.293369 Aug 31 13:42:15.099593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 290/571] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:14 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1557 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:15.120092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-dd50b314-ae91-48fc-a034-4d11e7f65774 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.201802 Aug 31 13:42:15.121686 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 282/572] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:14 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:15.280791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:15.281549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:15.289921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.290365 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.291158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.291590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.374523 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:42:15.379447 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:15.380161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:15.393237 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.393793 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.394958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.395390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.543177 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-601e0b35-5da6-4a14-b8ea-d398fac04589 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 204 len: 0 microversion: 2.1 time: 0.264558 Aug 31 13:42:15.546408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 291/573] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:42:15 2021] DELETE /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 0 bytes in 270 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:15.556411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:15.557119 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:15.565142 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.565580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.566387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.567094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.692210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:15.701983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:15.710622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:15.714001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7b77aecc-9f4f-4275-9d0a-82c042c6caf9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.338466 Aug 31 13:42:15.717651 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 283/574] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:15 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:15.920624 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:15.921405 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:15.939513 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.941302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:15.945836 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:15.950838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.140878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:16.154959 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d01c7c41-7a62-4902-a3d8-1498c369a135 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 200 len: 1472 microversion: 2.1 time: 0.238737 Aug 31 13:42:16.157188 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 284/575] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:15 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 1472 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:16.176882 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-4e4f77a1-ca9f-4b8f-8b1a-8ba0cf13e062 req-ef40111e-1c38-4407-b8a7-5f1128a22bdb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c7d383ef-a49f-4b9f-92f9-71b4b0493d96", "name": "network-vif-deleted", "tag": "98e342d6-9a45-48b2-9686-3c8ca491c352"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:16.180625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:16.180625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:42:16.200218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-4e4f77a1-ca9f-4b8f-8b1a-8ba0cf13e062 req-ef40111e-1c38-4407-b8a7-5f1128a22bdb service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.206154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-4e4f77a1-ca9f-4b8f-8b1a-8ba0cf13e062 req-ef40111e-1c38-4407-b8a7-5f1128a22bdb service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.246453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-4e4f77a1-ca9f-4b8f-8b1a-8ba0cf13e062 req-ef40111e-1c38-4407-b8a7-5f1128a22bdb service nova] Creating event network-vif-deleted:98e342d6-9a45-48b2-9686-3c8ca491c352 for instance c7d383ef-a49f-4b9f-92f9-71b4b0493d96 on hv-cinder-80660 Aug 31 13:42:16.263989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-4e4f77a1-ca9f-4b8f-8b1a-8ba0cf13e062 req-ef40111e-1c38-4407-b8a7-5f1128a22bdb service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100820 Aug 31 13:42:16.266680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 285/576] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:16 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:16.285078 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:16.287936 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:16.304800 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.305399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.306525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.307092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.322434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:16.330499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a7aa31a9-2cca-44bd-bcce-5b08b6f4d14d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1512 microversion: 2.1 time: 0.779392 Aug 31 13:42:16.341323 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 292/577] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:15 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1512 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:16.346429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:16.347621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:16.354599 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.355709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.356686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.357311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.440987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d29c4b5b-2089-4b3f-9205-59f527c88609 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.097607 Aug 31 13:42:16.442076 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 293/578] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:16 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:16.516019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:16.524835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1350ed13-3ab4-4737-bc1a-1890d8aba99f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1557 microversion: 2.1 time: 0.254002 Aug 31 13:42:16.525768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 286/579] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:16 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1557 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:16.738707 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:16.739722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:16.760693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.761464 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:16.763702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:16.764362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.063660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:17.073520 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:17.077918 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:17.079400 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-db82e3b5-9f34-494c-8296-f0adbd875584 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.345068 Aug 31 13:42:17.081063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 294/580] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:16 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:17.177158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:17.178700 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: c7d383ef-a49f-4b9f-92f9-71b4b0493d96] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:17.186081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.186829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.188168 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.188817 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.205077 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] HTTP exception thrown: Instance c7d383ef-a49f-4b9f-92f9-71b4b0493d96 could not be found. Aug 31 13:42:17.206041 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Returning 404 to user: Instance c7d383ef-a49f-4b9f-92f9-71b4b0493d96 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:17.207112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6d9b2220-96d6-4353-a417-f97c6ee98dda tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96" status: 404 len: 111 microversion: 2.1 time: 0.034960 Aug 31 13:42:17.207956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 287/581] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:17 2021] GET /compute/v2.1/servers/c7d383ef-a49f-4b9f-92f9-71b4b0493d96 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:42:17.216544 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:17.217875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:17.224620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.225150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.225996 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.226640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.260543 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:42:17.349907 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:17.350522 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:17.357881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.359076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.361750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.362764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.397754 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-494cbbee-8df1-47ec-8987-85f11696e5eb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 204 len: 0 microversion: 2.1 time: 0.181556 Aug 31 13:42:17.399660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 295/582] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:42:17 2021] DELETE /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:17.409937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:17.410771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:17.417262 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.417792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.418791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.419418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.588217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:17.602540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7d8ecb6f-4470-4493-9b6b-013fc94d5660 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1512 microversion: 2.1 time: 0.256352 Aug 31 13:42:17.613142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 288/583] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:17 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1512 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:17.621145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:17.623877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:17.645223 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.645924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.646854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.647466 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.728134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-789ebe96-325b-4238-a185-cbdf7e649510 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.113118 Aug 31 13:42:17.732582 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 289/584] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:17 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:17.745775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:17.749044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:17.779608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.780312 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.781178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:17.781615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:17.985007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:17.997786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-489f46da-f4d9-4fbe-b8f3-7d85ca76bedd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1557 microversion: 2.1 time: 0.264251 Aug 31 13:42:18.013874 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 290/585] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:17 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1557 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:18.057365 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:18.070578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e0058dff-f665-46f0-93b6-64643f9847d7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1512 microversion: 2.1 time: 0.666174 Aug 31 13:42:18.071606 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 296/586] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:17 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1512 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:18.102789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:18.103406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:18.113391 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:18.113846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:18.114645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:18.115076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:18.371894 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:18.387540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:18.388727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:18.393059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-111159e9-3d7e-4e70-8ddf-024af561138f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.294913 Aug 31 13:42:18.393714 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 291/587] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:18 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:18.629390 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:18.630677 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:18.641037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:18.659018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:18.661332 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:18.664568 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:18.743996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:18.748819 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:18.761981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:18.763634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:18.767852 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:18.768441 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:18.852255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-765c2330-c792-4bf9-89d2-ed1f9bacb7a5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.114067 Aug 31 13:42:18.857572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 292/588] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:18 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:19.031606 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:19.032656 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:19.044286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.045598 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.046727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.047513 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.254628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:19.265055 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fb574efd-9d53-493b-b886-411c456ff31f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 200 len: 1512 microversion: 2.1 time: 0.640048 Aug 31 13:42:19.265693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 297/589] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:18 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 1512 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:19.287678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:19.307331 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:19.321956 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.322495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.323361 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.325522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.339235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:19.348220 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3b07ec7a-a064-4acf-9400-cbfb495b308b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1563 microversion: 2.1 time: 0.327389 Aug 31 13:42:19.349383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 293/590] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:19 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1563 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:19.423293 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:19.424821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:19.439998 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.441408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.443373 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.443932 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.726509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:19.734247 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7c985cad-1df0-4f35-ae8f-e05e500c44bb tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1512 microversion: 2.1 time: 0.467047 Aug 31 13:42:19.742099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 298/591] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:19 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1512 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:19.757649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-f449106e-6ac6-4b38-a5a7-972693240018 req-728f353b-cdf4-48b0-8e13-4a4bcfbefd69 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fb6ec340-96e6-4018-933b-e3b1623e65da", "name": "network-vif-deleted", "tag": "946c3d14-63a6-44c9-afa6-783cd0c69a85"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:19.759923 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:19.759923 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:42:19.780233 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-f449106e-6ac6-4b38-a5a7-972693240018 req-728f353b-cdf4-48b0-8e13-4a4bcfbefd69 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.780703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-f449106e-6ac6-4b38-a5a7-972693240018 req-728f353b-cdf4-48b0-8e13-4a4bcfbefd69 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.804723 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-f449106e-6ac6-4b38-a5a7-972693240018 req-728f353b-cdf4-48b0-8e13-4a4bcfbefd69 service nova] Creating event network-vif-deleted:946c3d14-63a6-44c9-afa6-783cd0c69a85 for instance fb6ec340-96e6-4018-933b-e3b1623e65da on hv-cinder-80660 Aug 31 13:42:19.816665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-f449106e-6ac6-4b38-a5a7-972693240018 req-728f353b-cdf4-48b0-8e13-4a4bcfbefd69 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073160 Aug 31 13:42:19.817523 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 299/592] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:19 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:19.830274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:19.832921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:19.848546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.850936 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.857062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.858273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.907408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:19.923895 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:19.929349 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:19.930831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a43c5a0f-7f70-4c6e-b434-1d2e9ee86807 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.514296 Aug 31 13:42:19.933901 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 294/593] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:19 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:19.942779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:19.954633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:19.968779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.970793 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:19.971955 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:19.972861 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.025198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lazy-loading 'services' on Instance uuid 15246791-5821-4746-ab57-de3340921964 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:20.115224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2ebd8771-be58-4b3d-9b11-15f8ef664f6e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 0.178560 Aug 31 13:42:20.115871 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 295/594] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:19 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:20.203437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c6379086-3168-4fa4-9dfb-036c777e7b12 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "DELETE /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments/721c28e7-b3d1-4dcc-9cac-b7b2a687eedd" status: 202 len: 0 microversion: 2.1 time: 0.377998 Aug 31 13:42:20.204187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 300/595] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:42:19 2021] DELETE /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments/721c28e7-b3d1-4dcc-9cac-b7b2a687eedd => generated 0 bytes in 384 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:42:20.213997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:20.215287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:20.238463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.239935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.244957 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.250239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.284056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:20.284929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: fb6ec340-96e6-4018-933b-e3b1623e65da] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:20.295546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.295975 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.296845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.311916 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.340944 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] HTTP exception thrown: Instance fb6ec340-96e6-4018-933b-e3b1623e65da could not be found. Aug 31 13:42:20.346906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Returning 404 to user: Instance fb6ec340-96e6-4018-933b-e3b1623e65da could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:20.348090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-829a3622-a7ce-418c-b9c5-f1d0e782f5f4 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da" status: 404 len: 111 microversion: 2.1 time: 0.068662 Aug 31 13:42:20.350711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 301/596] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:20 2021] GET /compute/v2.1/servers/fb6ec340-96e6-4018-933b-e3b1623e65da => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:42:20.398908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-11ddfbac-3cb5-4db3-a6e1-65f47cb98e88 req-1a499b4b-93d1-44f2-9c91-94e91dcbeb46 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3cfc754c-3286-4482-8113-5e72cc0aeb76", "name": "network-vif-deleted", "tag": "70fec9ce-85f9-4426-b600-045a974f93bb"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:20.403423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fff304ff-c8e4-47a1-811b-46b89b4839b3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.193953 Aug 31 13:42:20.406235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:20.406235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:42:20.409799 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 296/597] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:42:20 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 197 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:20.413761 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-11ddfbac-3cb5-4db3-a6e1-65f47cb98e88 req-1a499b4b-93d1-44f2-9c91-94e91dcbeb46 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.414869 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-11ddfbac-3cb5-4db3-a6e1-65f47cb98e88 req-1a499b4b-93d1-44f2-9c91-94e91dcbeb46 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.445248 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-11ddfbac-3cb5-4db3-a6e1-65f47cb98e88 req-1a499b4b-93d1-44f2-9c91-94e91dcbeb46 service nova] Creating event network-vif-deleted:70fec9ce-85f9-4426-b600-045a974f93bb for instance 3cfc754c-3286-4482-8113-5e72cc0aeb76 on hv-cinder-80660 Aug 31 13:42:20.479209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-11ddfbac-3cb5-4db3-a6e1-65f47cb98e88 req-1a499b4b-93d1-44f2-9c91-94e91dcbeb46 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.087257 Aug 31 13:42:20.489159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 302/598] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:20 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:20.761407 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:20.763236 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:20.772042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.784634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.785716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.786233 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.857828 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.858267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.858719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'fault' on Instance uuid 3cfc754c-3286-4482-8113-5e72cc0aeb76 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:20.957695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:20.957956 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:20.958748 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:20.973553 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.974055 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.974944 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:20.975440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:20.977898 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0b31c5e7-cbfd-45a6-a4fb-d5f7fd6d85fe tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1306 microversion: 2.1 time: 0.222690 Aug 31 13:42:20.989108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 297/599] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:20 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1306 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:21.126916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:21.129382 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:21.136607 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:21.137050 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:21.138682 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:21.140485 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:21.329605 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:21.339374 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:21.343880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:21.346112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8f494ccf-70de-438e-be1f-4108c75ac47d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.392377 Aug 31 13:42:21.349922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 303/600] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:20 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:21.415271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:21.416502 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:21.424898 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:21.425246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:21.426018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:21.426437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:21.485024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0141d18b-169d-4fe0-976e-90d065834b9f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.073396 Aug 31 13:42:21.485852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 304/601] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:42:21 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 197 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:21.995387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:22.006850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:22.018378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.019029 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.020950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.022636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.075587 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.088956 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.089688 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'fault' on Instance uuid 3cfc754c-3286-4482-8113-5e72cc0aeb76 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:22.206526 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:22.221969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-61bcd50e-e374-4fe9-b85e-4b3ad51052d5 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1306 microversion: 2.1 time: 0.230616 Aug 31 13:42:22.224971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 305/602] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:21 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1306 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:22.366229 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:22.367378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:22.383160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.384488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.387805 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.391785 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.575359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:22.587904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:22.589982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:22.591362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d5ba77c2-e4cc-4ca9-897e-61a8be273f8e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.230119 Aug 31 13:42:22.592774 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 306/603] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:22 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:22.607758 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:22.609669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:22.617966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.620073 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.621190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:22.621783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:22.672946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-18d37f38-0844-471b-a7c7-6d4770773ff1 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.078613 Aug 31 13:42:22.673549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 307/604] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:42:22 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 197 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:23.243574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:23.245131 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:23.259612 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.260582 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:23.261791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.262431 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:23.331966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.332766 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:23.333530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lazy-loading 'fault' on Instance uuid 3cfc754c-3286-4482-8113-5e72cc0aeb76 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:23.392635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:23.401501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a2dfcb2c-8951-4f5c-b278-18d6bd075dd9 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 200 len: 1306 microversion: 2.1 time: 0.164119 Aug 31 13:42:23.402736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 308/605] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:23 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 1306 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:23.610017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:23.611112 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:23.631178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.631695 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:23.632606 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.633217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:23.717221 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fed2b863-d2c4-47a6-8d44-f7a76814727b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 28800 microversion: 2.1 time: 2.593755 Aug 31 13:42:23.724037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 298/606] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:21 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 28800 bytes in 2602 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:23.729990 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:23.737668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:23.757711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.758464 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:23.762116 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:23.762842 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:24.017804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6c750dc3-2410-49ef-8a58-ac51b6a58559 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.282166 Aug 31 13:42:24.023559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 299/607] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:42:23 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 197 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:24.128335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:24.137745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:24.139507 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:24.147449 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f8f6815d-381d-447e-b224-f3f7c91d4548 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.541754 Aug 31 13:42:24.148692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 309/608] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:23 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:24.418486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:24.419142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: 3cfc754c-3286-4482-8113-5e72cc0aeb76] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:24.426829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:24.428790 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:24.429663 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:24.430100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:24.447642 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] HTTP exception thrown: Instance 3cfc754c-3286-4482-8113-5e72cc0aeb76 could not be found. Aug 31 13:42:24.448673 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Returning 404 to user: Instance 3cfc754c-3286-4482-8113-5e72cc0aeb76 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:24.449585 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2a1db41d-0b10-4080-824c-1f24b653e1ae tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76" status: 404 len: 111 microversion: 2.1 time: 0.034962 Aug 31 13:42:24.468744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 300/609] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:24 2021] GET /compute/v2.1/servers/3cfc754c-3286-4482-8113-5e72cc0aeb76 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:42:24.729177 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:24.730119 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:24.739064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:24.739522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:24.740610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:24.741221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:24.844202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0217e7bf-5f46-476b-864f-f0db16685e21 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 30376 microversion: 2.1 time: 0.118591 Aug 31 13:42:24.845127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 310/610] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:24 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 30376 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:25.034931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:25.035866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:25.049962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.050647 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.051495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.052139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.121704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-113057fe-c473-4d4e-9e10-2c1106773b37 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092200 Aug 31 13:42:25.122780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 301/611] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:42:25 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964/os-volume_attachments => generated 25 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:42:25.171456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:25.172166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:25.179947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.180429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.181215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.181696 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.428849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:25.439280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:25.441158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:25.442666 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-db5c57e2-6a3c-41ee-8c0d-40db3682fe80 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1739 microversion: 2.20 time: 0.278111 Aug 31 13:42:25.444503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 311/612] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:25 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1739 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:25.682944 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:25.683433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:25.690782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.691478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.692459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.693043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.729909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:42:25.830051 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6c0cac82-2d0d-4faf-aae0-45d01492f300 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "DELETE /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 204 len: 0 microversion: 2.1 time: 0.151730 Aug 31 13:42:25.833343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 302/613] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:42:25 2021] DELETE /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:25.841617 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:25.843090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:25.849001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.849442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.850569 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.851172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.857653 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:25.859391 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:25.865431 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.866205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.867218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:25.867780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:25.992658 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-366c7077-b042-41e0-8369-190d2b565c73 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 32105 microversion: 2.1 time: 0.138982 Aug 31 13:42:25.993449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 303/614] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:25 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 32105 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:26.083279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:26.093259 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-207331b0-6861-4c5a-9602-478435818bb7 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1512 microversion: 2.1 time: 0.254354 Aug 31 13:42:26.094619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 312/615] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:25 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1512 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:26.471565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:26.472483 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:26.498484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:26.501314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:26.503359 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:26.505730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:26.856506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:26.867904 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:26.870413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:26.871759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6e89cef9-4816-4b74-881e-468d47a4e71b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1721 microversion: 2.20 time: 0.412071 Aug 31 13:42:26.873181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 304/616] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:26 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1721 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:27.005358 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:27.006326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:27.014225 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.014784 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.015661 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.016325 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.111135 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:27.111747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:27.118594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.119446 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.120234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.120699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.265259 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:27.274646 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8a98b406-d00d-4f7f-8141-c0c5ff1ff75a tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1512 microversion: 2.1 time: 0.166971 Aug 31 13:42:27.275912 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 305/617] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:27 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1512 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:27.719647 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:27.720924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:27.727627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.728332 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.729350 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.729752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.759439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:42:27.888446 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-10a6bf4b-4e3b-4ca9-b89a-7ebe441805bc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "DELETE /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 204 len: 0 microversion: 2.1 time: 0.173016 Aug 31 13:42:27.892880 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 306/618] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:42:27 2021] DELETE /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:27.905410 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:27.907133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:27.914562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.915003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:27.915838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:27.916271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:28.375302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:28.384325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:28.395088 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:28.396837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0769ab9e-8b5b-413c-bacf-203f28606666 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1721 microversion: 2.20 time: 0.500547 Aug 31 13:42:28.408923 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 307/619] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:27 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1721 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:28.414231 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:28.415236 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:28.422752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:28.423602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:28.424744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:28.427169 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:28.785480 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:28.794468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a957b245-6ef9-4981-b622-e53564f59881 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1509 microversion: 2.1 time: 0.383971 Aug 31 13:42:28.800007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 308/620] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:28 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1509 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:28.810248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:28.810937 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:28.824504 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:28.825419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:28.829219 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:28.829832 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:29.116170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:29.126939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4d32de51-b0c5-433c-8c3c-bb508d4a5485 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1512 microversion: 2.1 time: 0.324170 Aug 31 13:42:29.128437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 309/621] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:28 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1512 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:29.418624 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:29.419653 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:29.426676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:29.427524 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:29.428581 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:29.429238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:29.639771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7e42f832-0310-4dfd-8557-a42eb27b099b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 35100 microversion: 2.1 time: 2.637884 Aug 31 13:42:29.641733 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 313/622] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:26 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 35100 bytes in 2641 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:29.823031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:29.824574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:29.845642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:29.846093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:29.846910 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:29.847345 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:29.960058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:29.984689 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:29.986505 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:29.993469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cb8773eb-b4e7-451b-bc24-27937026fdf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1721 microversion: 2.20 time: 0.573926 Aug 31 13:42:29.994132 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 310/623] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:29 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1721 bytes in 580 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:30.026272 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2060075687", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "networks": [{"uuid": "a5c20a69-0932-4886-a293-fa89c7cd66cd"}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:30.099302 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:30.110893 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b58befdd-b119-49e5-89c7-771abae08c7d tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1509 microversion: 2.1 time: 0.296710 Aug 31 13:42:30.114630 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 314/624] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:29 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1509 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:30.138366 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-65960d81-6d59-455d-b955-a843fe966c68 req-e7515d01-4ca8-4b39-b734-573444b5fcac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "name": "network-vif-unplugged", "status": "completed", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:30.147635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:30.147635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:42:30.170378 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] validate_networks() for [('a5c20a69-0932-4886-a293-fa89c7cd66cd', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:42:30.178097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-65960d81-6d59-455d-b955-a843fe966c68 req-e7515d01-4ca8-4b39-b734-573444b5fcac service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:30.178530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-65960d81-6d59-455d-b955-a843fe966c68 req-e7515d01-4ca8-4b39-b734-573444b5fcac service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:30.195787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-65960d81-6d59-455d-b955-a843fe966c68 req-e7515d01-4ca8-4b39-b734-573444b5fcac service nova] Creating event network-vif-unplugged:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:42:30.202641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-65960d81-6d59-455d-b955-a843fe966c68 req-e7515d01-4ca8-4b39-b734-573444b5fcac service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.083473 Aug 31 13:42:30.203635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 315/625] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:30 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:30.220794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:30.222239 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:30.234081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:30.234718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:30.235820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:30.236431 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:30.435469 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:30.443764 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-89a70fe8-0ed8-418a-b0ab-34ffa67e2436 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1512 microversion: 2.1 time: 0.229778 Aug 31 13:42:30.444362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 316/626] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:30 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1512 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:30.652478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:30.654158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:30.661238 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:30.662094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:30.663145 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:30.663636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:30.774406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1ae3fc51-0de4-43f7-9df3-fb2cb0a76c1a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 35643 microversion: 2.1 time: 0.125431 Aug 31 13:42:30.776412 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 317/627] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:30 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 35643 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:31.017298 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:31.018000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:31.024960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.025580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.026377 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.026797 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.185362 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:42:31.186044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:42:31.186305 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:42:31.186851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:42:31.187495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:42:31.196957 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.197711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.198533 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.198971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.219192 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Getting quotas for project 5651d65709fb486eb25e57054dc889cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:42:31.224821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Getting quotas for user dfba192291f64cab941d1006c81380bc and project 5651d65709fb486eb25e57054dc889cc. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:42:31.240187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:42:31.243617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:42:31.279722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:31.292256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:31.294760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:31.296891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f0491509-587b-40b5-805b-215371c44172 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1721 microversion: 2.20 time: 0.283716 Aug 31 13:42:31.298111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 318/628] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:31 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1721 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:31.313189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:31.314051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:31.315796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f7b2ddb5-baee-4d7a-9e3b-74375eecd78f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.293759 Aug 31 13:42:31.321886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 311/629] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:42:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 1300 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:42:31.322159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.322822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.324047 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.324750 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.329016 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3341fcdd-139b-49d8-b627-efd4a4ada0f7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:31.330209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3341fcdd-139b-49d8-b627-efd4a4ada0f7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:31.418696 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3341fcdd-139b-49d8-b627-efd4a4ada0f7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:31.429229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3341fcdd-139b-49d8-b627-efd4a4ada0f7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1219 microversion: 2.1 time: 0.105481 Aug 31 13:42:31.442777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 312/630] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:31 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1219 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:31.463759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:31.464691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:31.472584 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.474073 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.475069 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.476673 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.566795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cde9252205de47b2897144a70d230022', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a9d8392a09c34c68a6b4f4beb18b7f1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:31.580111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2c049647-8bb2-4613-8ee4-bb59713cdc20 tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 200 len: 1470 microversion: 2.1 time: 0.122118 Aug 31 13:42:31.581432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 313/631] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:31 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 1470 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:31.588625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-f90da7b9-66b3-40e4-b47f-351d15713d28 req-87135d3a-6bfc-410e-af55-e9bfe91a1f26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d", "name": "network-vif-deleted", "tag": "2a47da21-cc4f-45bc-938e-e78634de7de1"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:31.591181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:31.591181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:42:31.597338 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:31.602561 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f90da7b9-66b3-40e4-b47f-351d15713d28 req-87135d3a-6bfc-410e-af55-e9bfe91a1f26 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.603614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-f90da7b9-66b3-40e4-b47f-351d15713d28 req-87135d3a-6bfc-410e-af55-e9bfe91a1f26 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.607434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-840c9c9b-3a9d-4168-b491-dc9a9a1bd4a6 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1509 microversion: 2.1 time: 0.307959 Aug 31 13:42:31.609413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 319/632] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:31 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1509 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:31.626809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-f90da7b9-66b3-40e4-b47f-351d15713d28 req-87135d3a-6bfc-410e-af55-e9bfe91a1f26 service nova] Creating event network-vif-deleted:2a47da21-cc4f-45bc-938e-e78634de7de1 for instance b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d on hv-cinder-80660 Aug 31 13:42:31.634675 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-f90da7b9-66b3-40e4-b47f-351d15713d28 req-87135d3a-6bfc-410e-af55-e9bfe91a1f26 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050958 Aug 31 13:42:31.640013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 314/633] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:31.788134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:31.789854 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:31.797803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.798455 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.799512 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:31.800951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:31.913120 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8686396b-9f1e-463c-9082-4e08eaf00200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Action: 'create', calling method: .version_select at 0x7f67f4579e50>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1084113261"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:31.922502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4ed6adae-0f02-4115-a55d-e178d0f3bfb2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 36488 microversion: 2.1 time: 0.138951 Aug 31 13:42:31.923500 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 315/634] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:31 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 36488 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:31.942150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-8686396b-9f1e-463c-9082-4e08eaf00200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:42:31.946383 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-8686396b-9f1e-463c-9082-4e08eaf00200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for user 83dc5c95f312476599549f1901dbe9ff and project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:42:32.107979 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-8686396b-9f1e-463c-9082-4e08eaf00200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:42:32.112771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-8686396b-9f1e-463c-9082-4e08eaf00200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for user 83dc5c95f312476599549f1901dbe9ff and project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:42:32.129098 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8686396b-9f1e-463c-9082-4e08eaf00200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2315 microversion: 2.1 time: 0.432211 Aug 31 13:42:32.134936 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 320/635] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 31 13:42:31 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:32.316315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:32.317812 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:32.335984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.339425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.339986 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.340613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.450243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:32.451561 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:32.460021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.460827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.461614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.462030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.530718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:32.539870 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1952072d-d575-4707-9f71-d442511d74a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1271 microversion: 2.1 time: 0.094448 Aug 31 13:42:32.549940 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 321/636] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:32 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1271 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:32.571525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:32.601050 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:32.602869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:32.604106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c0baab76-99e0-4ef0-b098-fd1aa5f0d42b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1721 microversion: 2.20 time: 0.292497 Aug 31 13:42:32.615538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:32.615538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] [instance: b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:32.616706 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 316/637] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:32 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1721 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:32.621972 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.622429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.626680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:32.629934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:32.631476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.632176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.648200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.649801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.651094 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.651910 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.676509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] HTTP exception thrown: Instance b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d could not be found. Aug 31 13:42:32.677555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] Returning 404 to user: Instance b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:32.679175 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7f0d8fad-6ca2-4d08-9b85-d03a30192d0f tempest-AttachVolumeNegativeTest-1803367009 tempest-AttachVolumeNegativeTest-1803367009-project] 10.222.0.21 "GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d" status: 404 len: 111 microversion: 2.1 time: 0.084446 Aug 31 13:42:32.683801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 322/638] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:32 2021] GET /compute/v2.1/servers/b71fd215-cbc7-4a3b-baa5-7a3afaba6c6d => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:42:32.939744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:32.941837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:32.948682 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.949397 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:32.950594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:32.951188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:33.051466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a3065277-656c-4f4f-9bce-86684ced05e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 37400 microversion: 2.1 time: 0.119443 Aug 31 13:42:33.053494 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 323/639] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:32 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 37400 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:42:33.126361 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:33.146823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a0f3403a-a420-4306-8a07-e15ab42eaa84 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1509 microversion: 2.1 time: 0.526384 Aug 31 13:42:33.147725 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 317/640] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:32 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1509 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:33.558193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:33.558924 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:33.578966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:33.579538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:33.580435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:33.581212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:33.622926 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:33.624918 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:33.643440 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:33.645035 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:33.646145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:33.649075 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:33.778141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:33.791148 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f2ce2527-91fd-459b-a045-005afca228a6 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1277 microversion: 2.1 time: 0.237219 Aug 31 13:42:33.792103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 324/641] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:33 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1277 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:33.980628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-505b311f-a807-4ed9-91f5-4f80b3691130 req-2306b5de-96c6-43e5-a751-aa5bd1c498fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "104c7902-81c4-4922-aa83-3e21a08ea7d6", "name": "network-vif-deleted", "tag": "7a8c44df-bf04-44bd-9614-fe66dc1eea0d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:33.991176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:33.991176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:42:34.022975 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-505b311f-a807-4ed9-91f5-4f80b3691130 req-2306b5de-96c6-43e5-a751-aa5bd1c498fa service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.023426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-505b311f-a807-4ed9-91f5-4f80b3691130 req-2306b5de-96c6-43e5-a751-aa5bd1c498fa service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.036046 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-505b311f-a807-4ed9-91f5-4f80b3691130 req-2306b5de-96c6-43e5-a751-aa5bd1c498fa service nova] Creating event network-vif-deleted:7a8c44df-bf04-44bd-9614-fe66dc1eea0d for instance 104c7902-81c4-4922-aa83-3e21a08ea7d6 on hv-cinder-80660 Aug 31 13:42:34.054889 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-505b311f-a807-4ed9-91f5-4f80b3691130 req-2306b5de-96c6-43e5-a751-aa5bd1c498fa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080474 Aug 31 13:42:34.055849 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 325/642] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:33 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:42:34.071163 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:34.071387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:34.072243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:34.088417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.088871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.089660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.090090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.111362 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:34.118846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:34.129356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6d03bfa1-ff0a-41b4-96be-c61fb17bf5a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1664 microversion: 2.20 time: 0.508900 Aug 31 13:42:34.147544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 318/643] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:33 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1664 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:34.155971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "eafc86dc-fc13-4b5f-a91f-1bb7b56d1afa"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:34.157463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:34.168201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.169205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.170246 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.170840 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.245531 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-24e1f192-864d-4b56-9ac2-b8f66eb1fbb3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 38324 microversion: 2.1 time: 0.183210 Aug 31 13:42:34.247928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 326/644] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:34 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 38324 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:34.258406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:34.261003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:34.275039 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.275483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.281920 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.283965 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.350120 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.350640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.351024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lazy-loading 'fault' on Instance uuid 104c7902-81c4-4922-aa83-3e21a08ea7d6 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:34.453708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:34.464997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8623115c-aed1-48d5-a065-f5e1280560e4 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 200 len: 1312 microversion: 2.1 time: 0.215082 Aug 31 13:42:34.465709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 327/645] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:34 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 1312 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:34.666173 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-401d9685-efe7-4672-97d2-5befc0a67ab5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.514699 Aug 31 13:42:34.669321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 319/646] 10.222.0.21 () {62 vars in 1364 bytes} [Tue Aug 31 13:42:34 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments => generated 188 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:34.811946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:34.821486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:34.841174 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.844852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.849077 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.853016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.984106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:34.985101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:34.997456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.997901 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:34.998776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:34.999401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.109036 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:35.119963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-27339028-0fa3-4277-9078-058fe9d6c277 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.314534 Aug 31 13:42:35.122127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 328/647] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:34 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:35.210806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b29ccec9-fee8-45ea-9acc-8a8b98fb24db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action" status: 202 len: 0 microversion: 2.20 time: 0.230439 Aug 31 13:42:35.211356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 320/648] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:42:34 2021] POST /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/action => generated 0 bytes in 232 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:35.220170 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:35.221410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:35.227977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.228557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.229725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.230220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.262160 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:35.263217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:35.276499 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.276971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.279828 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.281008 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.393419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-10a17102-4f5b-4d20-9232-b8d9e1ddb827 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 38324 microversion: 2.1 time: 0.136573 Aug 31 13:42:35.399498 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 321/649] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:35 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 38324 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:35.485575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:35.487387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 104c7902-81c4-4922-aa83-3e21a08ea7d6] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:35.505204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.506477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.509617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.510329 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.515941 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:35.532854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:35.534800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:35.545197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a74548dc-53c7-49eb-a338-dde2a594e01b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1750 microversion: 2.20 time: 0.329348 Aug 31 13:42:35.548505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 329/650] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:35 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1750 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:35.555902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] HTTP exception thrown: Instance 104c7902-81c4-4922-aa83-3e21a08ea7d6 could not be found. Aug 31 13:42:35.565921 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Returning 404 to user: Instance 104c7902-81c4-4922-aa83-3e21a08ea7d6 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:35.569684 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5c631a84-9610-4abc-851d-5e26da0eddef tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6" status: 404 len: 111 microversion: 2.1 time: 0.089856 Aug 31 13:42:35.572556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 322/651] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:35 2021] GET /compute/v2.1/servers/104c7902-81c4-4922-aa83-3e21a08ea7d6 => generated 111 bytes in 94 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:42:35.581307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:35.582223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:35.594772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.595255 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.596262 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.597710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.644751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:42:35.747963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-28cb8b7e-b7ea-4f6b-b229-4a28eae4159b req-1a5b62d6-9588-4dbb-866e-f0010b32b9a6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2321f757-4259-4311-aa8c-d0e3598f91b5", "tag": "8e244733-f35a-470a-9e05-32c5b1061ef6"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:35.752411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:35.752411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:42:35.776760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-82b1984e-9663-4c0a-9e59-274b7c63ac19 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "DELETE /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 204 len: 0 microversion: 2.1 time: 0.198649 Aug 31 13:42:35.777740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 330/652] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:42:35 2021] DELETE /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:42:35.788210 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:35.790728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:35.805717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-28cb8b7e-b7ea-4f6b-b229-4a28eae4159b req-1a5b62d6-9588-4dbb-866e-f0010b32b9a6 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.806162 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.806604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.807380 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:35.807799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.808071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-28cb8b7e-b7ea-4f6b-b229-4a28eae4159b req-1a5b62d6-9588-4dbb-866e-f0010b32b9a6 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:35.835622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-28cb8b7e-b7ea-4f6b-b229-4a28eae4159b req-1a5b62d6-9588-4dbb-866e-f0010b32b9a6 service nova] Creating event network-changed:8e244733-f35a-470a-9e05-32c5b1061ef6 for instance 2321f757-4259-4311-aa8c-d0e3598f91b5 on hv-cinder-80660 Aug 31 13:42:35.850525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-28cb8b7e-b7ea-4f6b-b229-4a28eae4159b req-1a5b62d6-9588-4dbb-866e-f0010b32b9a6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106436 Aug 31 13:42:35.854716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 323/653] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:35 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:42:36.117406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:36.126618 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4cc14a14-a8c3-4991-8b56-45f50cef826c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.344098 Aug 31 13:42:36.129953 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 331/654] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:35 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:36.139453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:36.140190 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:36.155619 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:36.156072 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:36.157249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:36.157829 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:36.454380 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e7009522-4df6-42b8-b8d8-c5e8dd095633 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Action: 'create', calling method: .version_select at 0x7f67f44420d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1947890021", "metadata": {"Type": "work"}}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:36.527210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:36.536555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-87d6c2a4-fd63-4a2d-9349-d1fa765d903b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.402197 Aug 31 13:42:36.550123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 324/655] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:36 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:36.556081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:36.566569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:36.599747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:36.600596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:36.603150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:36.603985 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:36.692357 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a6becc98-1628-4023-8cc4-35cb021dc59a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 38324 microversion: 2.1 time: 0.139805 Aug 31 13:42:36.693341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 325/656] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:36 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 38324 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:36.705057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:36.706814 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:36.731983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:36.734792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:36.735809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:36.736427 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.049681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e7009522-4df6-42b8-b8d8-c5e8dd095633 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.834761 Aug 31 13:42:37.050333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 332/657] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 31 13:42:36 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 836 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 31 13:42:37.066204 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-06c7f26e-e200-4175-a82d-5ce5be6514f9 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Calling method '.version_select at 0x7f67f43b6c10>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:37.141674 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:37.152779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:37.154547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:37.156127 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0b50d0ed-4682-4c37-81b1-944953c35efa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1750 microversion: 2.20 time: 0.460815 Aug 31 13:42:37.156897 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 326/658] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:36 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1750 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:37.160743 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-06c7f26e-e200-4175-a82d-5ce5be6514f9 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23" status: 200 len: 353 microversion: 2.1 time: 0.098793 Aug 31 13:42:37.162018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 333/659] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:42:37 2021] GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23 => generated 353 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:37.167693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:37.170066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:37.179877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.180334 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.181141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.181756 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.411580 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:37.419044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-047757ec-3192-458c-b6f8-6f791d3af70a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.257601 Aug 31 13:42:37.419636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 327/660] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:37 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:37.567504 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:37.568215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:37.575613 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.576069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.577306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.577742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.706618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:37.707372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:37.708272 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:37.715641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.716172 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.716285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-550e8331-29a6-4217-bbc0-1316d8bdfb71 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.153157 Aug 31 13:42:37.717112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.717628 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.718381 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 334/661] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:37 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:37.815997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-863f22ad-817e-4b77-8d7a-36f6d81f41ab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 200 len: 38453 microversion: 2.1 time: 0.113616 Aug 31 13:42:37.825988 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 328/662] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:42:37 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 38453 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:42:37.836616 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:37.837333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:37.843975 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.844540 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.845385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:37.845842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:37.870857 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4aa152b9-fb9a-4a8c-8520-678e3e83c7bd tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/ips" status: 200 len: 145 microversion: 2.1 time: 0.038641 Aug 31 13:42:37.873927 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 335/663] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 31 13:42:37 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/ips => generated 145 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:38.178095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.178916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:38.179879 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8e86d540-d798-4f2b-8913-c1df6d0ceb47 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Calling method '.version_select at 0x7f67f46ccca0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.205486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:38.205486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:38.205486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:38.205486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:38.253873 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8e86d540-d798-4f2b-8913-c1df6d0ceb47 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23" status: 200 len: 354 microversion: 2.1 time: 0.077457 Aug 31 13:42:38.254906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 336/664] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:42:38 2021] GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23 => generated 354 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:38.268188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-dff58e89-d52e-43ee-ae13-4c16bbd1b573 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Calling method '.version_select at 0x7f67f43b6820>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.323587 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-dff58e89-d52e-43ee-ae13-4c16bbd1b573 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23" status: 200 len: 354 microversion: 2.1 time: 0.060912 Aug 31 13:42:38.324150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 337/665] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:42:38 2021] GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23 => generated 354 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:38.335661 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-91c8643e-8f1d-4892-850a-67bf1ac7afe2 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Calling method '.version_select at 0x7f67f4408a60>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.376087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:38.386133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:38.389673 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:38.391211 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-83de5bbd-63ec-4681-ba1b-b651fa0c0778 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.217959 Aug 31 13:42:38.395675 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 329/666] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:38 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:38.407938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-91c8643e-8f1d-4892-850a-67bf1ac7afe2 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23" status: 202 len: 0 microversion: 2.1 time: 0.075736 Aug 31 13:42:38.408771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 338/667] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 31 13:42:38 2021] DELETE /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:42:38.416565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-272c8f25-efdd-4a26-843a-efe57b83c6f4 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Calling method '.version_select at 0x7f67f4bd3f70>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.436443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.437105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:38.444712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:38.445152 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:38.445929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:38.446354 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:38.486639 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-272c8f25-efdd-4a26-843a-efe57b83c6f4 tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23" status: 200 len: 353 microversion: 2.1 time: 0.073902 Aug 31 13:42:38.487584 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 330/668] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:42:38 2021] GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23 => generated 353 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:38.595668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:38.603940 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2869c090-856c-42d7-aa06-da7437a0090c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.171121 Aug 31 13:42:38.604548 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 339/669] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:38 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:38.734502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:38.735194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:38.741702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:38.742185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:38.742968 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:38.743398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:38.968097 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:38.976838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3c42b9e5-adec-41bb-b944-0a9ab343955c tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.245780 Aug 31 13:42:38.977400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 331/670] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:38 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:39.411930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:39.412596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:39.418573 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:39.419117 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:39.419955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:39.420473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:39.499443 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-146d65c1-7792-4a7c-89c8-761c5591419e tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Calling method '.version_select at 0x7f67f4c30040>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:39.538252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-146d65c1-7792-4a7c-89c8-761c5591419e tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] HTTP exception thrown: Volume d4b3cccf-a21b-4b70-aca1-9f1caba48e23 could not be found. Aug 31 13:42:39.538859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-146d65c1-7792-4a7c-89c8-761c5591419e tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] Returning 404 to user: Volume d4b3cccf-a21b-4b70-aca1-9f1caba48e23 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:39.539727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-146d65c1-7792-4a7c-89c8-761c5591419e tempest-VolumesGetTestJSON-1732667938 tempest-VolumesGetTestJSON-1732667938-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23" status: 404 len: 109 microversion: 2.1 time: 0.044582 Aug 31 13:42:39.540537 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 332/671] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:42:39 2021] GET /compute/v2.1/os-volumes/d4b3cccf-a21b-4b70-aca1-9f1caba48e23 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:42:39.552940 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:39.562531 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:39.564422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:39.565902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6abbc47b-fb06-4c39-8310-65ea8102dd24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.157781 Aug 31 13:42:39.566864 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 340/672] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:39 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:39.621734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:39.622914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:39.630736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:39.631187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:39.631956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:39.632396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:39.777946 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:39.786678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0f93e3f7-fb17-43a6-9dc6-4f878cc0b72f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.169002 Aug 31 13:42:39.787927 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 333/673] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:39 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:40.003930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:40.004947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:40.019374 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.019896 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.020945 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.021546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.334783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:40.348243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-86cb90df-0c14-41b5-9e03-068ea0100ed5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.348438 Aug 31 13:42:40.348884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 341/674] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:39 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:40.489736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ea704a35-1084-4eed-9e21-4b1863d08cb8"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:40.491264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:40.501913 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.503174 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.505299 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.505890 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.584884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:40.586104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:40.594816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.599411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.609451 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.631437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.814494 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:40.825937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:40.828560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:40.830024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-152792c1-5b6a-4397-837e-7247e827058a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.249154 Aug 31 13:42:40.832082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 342/675] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:40 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:40.837396 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:40.838393 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:40.845986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.846821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.848032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:40.848728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:40.991193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:41.003415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9577ae06-42d6-4312-af37-dd28c2564a1a tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.169870 Aug 31 13:42:41.004281 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 343/676] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:40 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:41.366311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:41.366921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:41.373199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:41.373773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:41.374560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:41.374983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:41.518156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:41.527203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c1a0c317-c29b-42a1-b525-1307318cae48 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.164998 Aug 31 13:42:41.528081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 344/677] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:41 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:41.668735 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2d101f1f-3462-4264-bcb4-c2334a1a2363 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Action: 'create', calling method: .version_select at 0x7f67f4482550>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-972060423", "metadata": {"Type": "work"}}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:41.670326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2d101f1f-3462-4264-bcb4-c2334a1a2363 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:41.671280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2d101f1f-3462-4264-bcb4-c2334a1a2363 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.141975 Aug 31 13:42:41.671884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 345/678] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 31 13:42:41 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 143 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:42:41.681260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2f3a5384-f814-495a-9906-147bc4016019 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Action: 'create', calling method: .version_select at 0x7f67f4487430>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-721267939", "metadata": {"Type": "work"}}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:41.682532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2f3a5384-f814-495a-9906-147bc4016019 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:41.683341 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2f3a5384-f814-495a-9906-147bc4016019 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.005925 Aug 31 13:42:41.686008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 346/679] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 31 13:42:41 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 13:42:41.695604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-10915c1c-4b93-409a-95f3-c349c3035373 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Action: 'create', calling method: .version_select at 0x7f67f4482af0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1902084356", "metadata": {"Type": "work"}}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:41.696916 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-10915c1c-4b93-409a-95f3-c349c3035373 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:41.697739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-10915c1c-4b93-409a-95f3-c349c3035373 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.006385 Aug 31 13:42:41.698270 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 347/680] 10.222.0.21 () {60 vars in 1156 bytes} [Tue Aug 31 13:42:41 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 7 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 31 13:42:41.706239 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-958257b4-52b7-4f30-8676-e3506d7240b4 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Calling method '.version_select at 0x7f67f43b2f70>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:41.738024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-958257b4-52b7-4f30-8676-e3506d7240b4 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] HTTP exception thrown: Volume tempest-invalid-1144515214 could not be found. Aug 31 13:42:41.738645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-958257b4-52b7-4f30-8676-e3506d7240b4 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Returning 404 to user: Volume tempest-invalid-1144515214 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:41.739497 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-958257b4-52b7-4f30-8676-e3506d7240b4 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1144515214" status: 404 len: 99 microversion: 2.1 time: 0.036472 Aug 31 13:42:41.740257 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 348/681] 10.222.0.21 () {58 vars in 1218 bytes} [Tue Aug 31 13:42:41 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-1144515214 => generated 99 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Aug 31 13:42:41.756608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7f0bae60-9533-4c1e-9fee-1a0cc1cf16a6 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004469 Aug 31 13:42:41.761797 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 349/682] 10.222.0.21 () {58 vars in 1140 bytes} [Tue Aug 31 13:42:41 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 13:42:41.767439 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0d0f1837-7d9a-4396-82a8-9b153b1cc08a tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004357 Aug 31 13:42:41.767947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 350/683] 10.222.0.21 () {58 vars in 1137 bytes} [Tue Aug 31 13:42:41 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 31 13:42:41.776388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1f4d2e60-278b-4a1e-87ba-8c8a315d0fc8 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Calling method '.version_select at 0x7f67f43b21f0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:41.809694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-1f4d2e60-278b-4a1e-87ba-8c8a315d0fc8 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] HTTP exception thrown: Volume 13a4c391-c26a-49a2-a8b9-10062696323a could not be found. Aug 31 13:42:41.810662 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1f4d2e60-278b-4a1e-87ba-8c8a315d0fc8 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Returning 404 to user: Volume 13a4c391-c26a-49a2-a8b9-10062696323a could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:41.812130 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1f4d2e60-278b-4a1e-87ba-8c8a315d0fc8 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/13a4c391-c26a-49a2-a8b9-10062696323a" status: 404 len: 109 microversion: 2.1 time: 0.039012 Aug 31 13:42:41.812931 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 351/684] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 31 13:42:41 2021] DELETE /compute/v2.1/os-volumes/13a4c391-c26a-49a2-a8b9-10062696323a => generated 109 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:42:41.824591 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f357dda1-08ac-435f-857e-990c2dfb80b5 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Calling method '.version_select at 0x7f67f463df70>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:41.863741 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-f357dda1-08ac-435f-857e-990c2dfb80b5 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] HTTP exception thrown: Volume 142cc35f-60f3-455c-82e2-727cfe03dd38 could not be found. Aug 31 13:42:41.864338 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f357dda1-08ac-435f-857e-990c2dfb80b5 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] Returning 404 to user: Volume 142cc35f-60f3-455c-82e2-727cfe03dd38 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:41.865455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f357dda1-08ac-435f-857e-990c2dfb80b5 tempest-VolumesNegativeTest-1035034651 tempest-VolumesNegativeTest-1035034651-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/142cc35f-60f3-455c-82e2-727cfe03dd38" status: 404 len: 109 microversion: 2.1 time: 0.045509 Aug 31 13:42:41.866251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 352/685] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:42:41 2021] GET /compute/v2.1/os-volumes/142cc35f-60f3-455c-82e2-727cfe03dd38 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:42:41.871190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:41.871791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:41.879962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:41.882254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:41.882254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:41.882254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:42.105702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:42.118224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:42.120315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:42.121808 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-577189eb-f5f0-4dff-bbb1-aa1d6f2cd724 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.254430 Aug 31 13:42:42.133843 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 353/686] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:41 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:42.139721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:42.140980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:42.150130 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:42.150658 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:42.151704 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:42.152204 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:42.359355 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:42.371024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8f03b1fd-b7d2-4734-b506-8d19d18cb219 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.234717 Aug 31 13:42:42.372337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 354/687] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:42 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:42.385224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-d52cb880-d033-4eca-971c-6d369265ff65 req-8958257b-7fd4-4651-a55c-ee49e9dad18c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2321f757-4259-4311-aa8c-d0e3598f91b5", "name": "network-vif-plugged", "status": "completed", "tag": "8e244733-f35a-470a-9e05-32c5b1061ef6"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:42.389271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:42.389271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:42:42.401372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d52cb880-d033-4eca-971c-6d369265ff65 req-8958257b-7fd4-4651-a55c-ee49e9dad18c service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:42.402253 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d52cb880-d033-4eca-971c-6d369265ff65 req-8958257b-7fd4-4651-a55c-ee49e9dad18c service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:42.416268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-d52cb880-d033-4eca-971c-6d369265ff65 req-8958257b-7fd4-4651-a55c-ee49e9dad18c service nova] Creating event network-vif-plugged:8e244733-f35a-470a-9e05-32c5b1061ef6 for instance 2321f757-4259-4311-aa8c-d0e3598f91b5 on hv-cinder-80660 Aug 31 13:42:42.421545 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-d52cb880-d033-4eca-971c-6d369265ff65 req-8958257b-7fd4-4651-a55c-ee49e9dad18c service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047784 Aug 31 13:42:42.422164 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 355/688] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:42.549731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:42.550922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:42.564105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:42.565077 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:42.567274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:42.567881 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:42.756194 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:42.766316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f4adad06-375e-42ec-9d72-308bb6b34bd7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.225075 Aug 31 13:42:42.766904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 356/689] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:42 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:43.141031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:43.141708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:43.152186 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:43.152655 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:43.153655 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:43.154210 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:43.307304 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:43.322199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:43.324285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:43.325846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3be12a02-30be-4938-9f95-89584b0c288e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.188493 Aug 31 13:42:43.328321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 357/690] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:43 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:43.388880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:43.389895 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:43.395742 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:43.396189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:43.396998 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:43.397427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:43.554064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:43.566629 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8d60e4ac-0bc3-43f8-8ca2-c924a41d5dda tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.181658 Aug 31 13:42:43.567630 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 358/691] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:43 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:43.783067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:43.783744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:43.789795 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:43.790486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:43.791703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:43.792288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:43.942513 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:43.953201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-eedf58af-5661-447b-9e3c-78ddf8d9dbf0 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.173751 Aug 31 13:42:43.954198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 359/692] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:43 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:44.353634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:44.354355 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:44.368647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:44.369082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:44.370030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:44.370454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:44.518837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:44.527643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:44.529169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:44.530608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-26262154-0fdf-425c-a38e-6129aa4a7486 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.189283 Aug 31 13:42:44.531707 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 360/693] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:44 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:44.586771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:44.587557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:44.594806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:44.595283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:44.596038 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:44.596493 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:44.760627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:44.770320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-596f0135-e595-4fcc-818a-0768d00b2a6f tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.187979 Aug 31 13:42:44.772227 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 361/694] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:44 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:44.972179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:44.972899 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:44.980437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:44.980912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:44.981999 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:44.982460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:45.157703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:45.165302 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-94b8edcf-a496-4c9d-9518-c8457cc1ef01 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.197711 Aug 31 13:42:45.174972 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 362/695] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:44 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:45.553338 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:45.554143 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:45.560508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:45.561628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:45.562524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:45.563041 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:45.780288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:45.793201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:45.799722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:45.800403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-aed0dcf3-f983-4536-a679-9f086dfe4bcc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.251939 Aug 31 13:42:45.801268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 363/696] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:45 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:45.808172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:45.808805 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:45.815505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:45.815943 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:45.816786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:45.817218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:46.054356 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:46.064219 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-38317ff0-c673-4df8-ac6a-8547f4790f55 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.260068 Aug 31 13:42:46.065085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 364/697] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:45 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:46.182829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:46.183430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:46.194050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:46.194495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:46.195271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:46.195694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:46.353590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:46.363255 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b8851e97-436c-4b1b-804c-6c18d4635e17 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.184107 Aug 31 13:42:46.366995 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 365/698] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:46 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:46.821044 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:46.821671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:46.829228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:46.829807 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:46.830697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:46.831220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:46.996777 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:47.008593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:47.010868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:47.012200 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-511339f5-7f67-4dca-8609-6eb94ea96c45 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.196049 Aug 31 13:42:47.013353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 366/699] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:46 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:47.082694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:47.083547 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:47.089881 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:47.090307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:47.091116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:47.091549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:47.239469 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:47.252156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-20435541-c98f-4661-a556-caa6363417bf tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.173342 Aug 31 13:42:47.253383 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 367/700] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:47 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:47.380728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:47.381333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:47.387760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:47.388506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:47.389933 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:47.390538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:47.552757 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:47.561282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b86cef4a-ce84-47a3-aa56-141fb8cb48e7 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.184119 Aug 31 13:42:47.562375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 368/701] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:47 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:48.033408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:48.034271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:48.041455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:48.042114 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:48.043124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:48.043642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:48.200846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:48.212481 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:48.214441 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:48.215775 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9cf51128-6974-457a-b086-ce568647efd7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.187017 Aug 31 13:42:48.216566 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 369/702] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:48 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:48.270422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:48.271031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:48.277614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:48.278340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:48.279316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:48.279908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:48.430430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:48.438945 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c2e63ff1-5b03-4799-9284-8b373e341344 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.172516 Aug 31 13:42:48.440145 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 370/703] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:48 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:48.578794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:48.579781 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:48.585989 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:48.586439 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:48.587571 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:48.587690 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:48.802228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:48.819925 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9f31197e-e50a-434a-9a2c-f77e39585f90 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.245120 Aug 31 13:42:48.820842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 371/704] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:48 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:49.236251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:49.237020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:49.244406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:49.244842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:49.245632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:49.246058 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:49.400160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:49.411030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:49.412594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:49.413747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f9382092-790e-4ca5-b4db-5179b0a65824 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.182594 Aug 31 13:42:49.414311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 372/705] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:49 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:49.456952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:49.457712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:49.464080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:49.464652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:49.465565 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:49.466152 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:49.677240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:49.684749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-16e84582-15ae-4523-ba0f-c59564d1db32 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.231403 Aug 31 13:42:49.685603 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 373/706] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:49 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:49.838816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:49.839435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:49.846632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:49.847178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:49.848566 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:49.848998 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:49.999656 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:50.007454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b2ccad3e-fdc3-4d18-81ef-671cba34ca78 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.173015 Aug 31 13:42:50.008096 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 374/707] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:49 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:50.432328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:50.433101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:50.439820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:50.440388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:50.441498 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:50.442256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:50.611113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:50.638976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:50.640702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:50.641959 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-92723b8c-cfd8-487b-9e73-729d77a9536f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.213967 Aug 31 13:42:50.642514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 375/708] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:50 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:50.701811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:50.702736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:50.710226 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:50.710992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:50.711960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:50.712416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:50.855501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:50.863307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3ae68c03-c718-4535-8a92-ef8d2facf550 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.165453 Aug 31 13:42:50.863976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 376/709] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:50 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:51.025161 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:51.025820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:51.032699 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:51.033141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:51.033952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:51.034383 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:51.168024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:51.178405 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-20c7169d-ad86-4228-8c68-39ed124820d2 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.156839 Aug 31 13:42:51.179138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 377/710] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:51 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:51.662138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:51.662877 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:51.668985 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:51.669429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:51.670209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:51.670767 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:51.812132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:51.821467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:51.822969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:51.824124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-43412ea3-46b4-49a9-a163-9f4adbf60386 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.165997 Aug 31 13:42:51.824721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 378/711] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:51 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:51.882689 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:51.883459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:51.890987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:51.891421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:51.892211 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:51.892669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:52.022285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:52.031189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6ab3688a-b10b-4d98-a9e9-8970d8df9309 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.153822 Aug 31 13:42:52.031768 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 379/712] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:51 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:52.196727 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:52.197336 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:52.204734 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:52.205213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:52.206149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:52.206710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:52.339580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:52.348057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bc7cc037-20e3-4533-9bdc-58fa0539fe93 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.156673 Aug 31 13:42:52.348678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 380/713] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:52 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:52.845525 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:52.846241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:52.854847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:52.855415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:52.856468 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:52.856927 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:52.996980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:53.006015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:53.007475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:53.008643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9f4e7b3c-92fa-47ab-8b14-75d22bb24a56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.168579 Aug 31 13:42:53.009243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 381/714] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:52 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:53.049450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:53.050250 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:53.057005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:53.057457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:53.058241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:53.058695 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:53.195546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:53.204127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fd613566-8bc7-45ba-a73f-59eb7d4fa4fc tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.159745 Aug 31 13:42:53.204778 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 382/715] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:53 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:53.366207 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:53.366809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:53.373352 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:53.373792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:53.374554 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:53.374971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:53.511188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:53.519214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4d8d3398-dc52-4e6d-8a01-1f769cd50edc tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.156911 Aug 31 13:42:53.519803 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 383/716] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:53 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:54.027485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:54.028153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:54.036060 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:54.036774 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:54.037962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:54.038424 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:54.180788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:54.191097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:54.192612 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:54.194046 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c2460c5e-c2ad-4c44-a36a-2bb53aa9d3df tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.170516 Aug 31 13:42:54.194613 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 384/717] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:54 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:54.221589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:54.222294 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:54.228580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:54.229025 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:54.229794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:54.230221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:54.374277 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:54.385577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ae69a906-d80a-4b03-8642-73343d71a5bd tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.167702 Aug 31 13:42:54.396754 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 385/718] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:54 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:42:54.499991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-662d40f4-d4d1-4d71-831f-d2b06cde063f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 14.014091 Aug 31 13:42:54.505272 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 334/719] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:42:40 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-volume_attachments => generated 194 bytes in 14016 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:54.540873 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:54.542640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:54.554377 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:54.555371 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:54.556346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:54.557310 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:54.710555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:54.718457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-31ee270f-4e51-48c7-a8d5-c9306f9b6a43 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.186282 Aug 31 13:42:54.719060 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 386/720] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:54 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:55.213818 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:55.214500 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:55.228150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:55.228780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:55.229712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:55.230143 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:55.358659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:55.368865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:55.370362 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:55.371527 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3126f726-e2fb-4eda-aa04-cee35bcc0041 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.161996 Aug 31 13:42:55.372069 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 335/721] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:55 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:55.402904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:55.403503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:55.409641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:55.410179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:55.411128 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:55.411615 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:55.548683 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:55.556729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-19f81fe2-02bf-4f26-bb1d-ba694f34d8d3 tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.157444 Aug 31 13:42:55.557301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 387/722] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:55 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:55.739638 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:55.740321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:55.750331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:55.750869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:55.752596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:55.753042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:55.905555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:55.914119 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9aaad322-d857-4fc2-9390-1c2997d03ea5 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1319 microversion: 2.1 time: 0.180839 Aug 31 13:42:55.915063 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 336/723] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:55 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1319 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:56.391199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:56.391877 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:56.398902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:56.399514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:56.400326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:56.400794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:56.543783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:56.555387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:56.557012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:56.558200 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c7ebab59-b5c1-4cbe-afc0-b1586db98114 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.171076 Aug 31 13:42:56.559235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 388/724] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:56 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:56.573524 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:56.574122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:56.580225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:56.580733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:56.581494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:56.581916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:56.716222 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:56.724947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f847612e-da6f-436b-a715-438c93ad440b tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1523 microversion: 2.1 time: 0.154644 Aug 31 13:42:56.725564 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 337/725] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:56 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:56.778191 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-434949122", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1084113261", "security_groups": [{"name": "tempest-secgroup-smoke-2048621792"}], "block_device_mapping_v2": [{"uuid": "17a66ab2-7254-458c-a6fe-f027ad4548f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eadfe07a-649e-4ecc-ab96-dbd117253913"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:56.908042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] validate_networks() for [('eadfe07a-649e-4ecc-ab96-dbd117253913', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:42:56.931327 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:56.931950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:56.938718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:56.939139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:56.939931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:56.940331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.105136 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:57.113397 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3d888593-48b4-4c45-8c92-1a834bfbe18f tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1507 microversion: 2.1 time: 0.185938 Aug 31 13:42:57.124437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 338/726] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:56 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1507 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:57.131167 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5b9ef497-c63d-4c5f-9012-82a2466dcbe6", "device": "/dev/sdb"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:57.132789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:57.139921 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.140636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.141587 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.142198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.305411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:42:57.305785 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:42:57.306246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:42:57.306645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:42:57.307057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:42:57.316596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.317033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.317919 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.318270 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.337607 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:42:57.341844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for user 83dc5c95f312476599549f1901dbe9ff and project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:42:57.409456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:42:57.411572 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17a66ab2-7254-458c-a6fe-f027ad4548f1',volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:42:57.434845 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-124ac848-afc9-43b2-ba0f-830da30cfab3 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "POST /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307419 Aug 31 13:42:57.442346 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 339/727] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:42:57 2021] POST /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5/os-volume_attachments => generated 194 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:57.577929 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:57.579204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:57.587548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.588494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.590495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.591128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.602545 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-396feaa9-8d17-4a2d-96fb-0ca5a0ad7e71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.828084 Aug 31 13:42:57.603193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 389/728] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:42:56 2021] POST /compute/v2.1/servers => generated 406 bytes in 829 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:42:57.612759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-10f27f44-4b1c-4587-8477-a7c0022095c6 req-eeb69672-10b1-4d42-ba7e-584bf9d40f0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15246791-5821-4746-ab57-de3340921964", "name": "network-vif-deleted", "tag": "fb7a1805-78d8-4153-9f95-bc07f9da66f1"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:42:57.614922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:42:57.614922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:42:57.633149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-10f27f44-4b1c-4587-8477-a7c0022095c6 req-eeb69672-10b1-4d42-ba7e-584bf9d40f0d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.635845 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-10f27f44-4b1c-4587-8477-a7c0022095c6 req-eeb69672-10b1-4d42-ba7e-584bf9d40f0d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.652885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-10f27f44-4b1c-4587-8477-a7c0022095c6 req-eeb69672-10b1-4d42-ba7e-584bf9d40f0d service nova] Creating event network-vif-deleted:fb7a1805-78d8-4153-9f95-bc07f9da66f1 for instance 15246791-5821-4746-ab57-de3340921964 on hv-cinder-80660 Aug 31 13:42:57.658137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-10f27f44-4b1c-4587-8477-a7c0022095c6 req-eeb69672-10b1-4d42-ba7e-584bf9d40f0d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053312 Aug 31 13:42:57.659671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 390/729] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:42:57 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:42:57.665160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d55b1e31-cb86-4ba9-b808-4ea99ae5a198 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:57.666165 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d55b1e31-cb86-4ba9-b808-4ea99ae5a198 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:57.736556 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d55b1e31-cb86-4ba9-b808-4ea99ae5a198 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:57.744092 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d55b1e31-cb86-4ba9-b808-4ea99ae5a198 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1094 microversion: 2.1 time: 0.082890 Aug 31 13:42:57.748992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 391/730] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:57 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1094 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:57.756104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:57.758375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:57.767534 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.767925 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.768807 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.769279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.782789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:57.793453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:57.795770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:57.798755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fc57944b-c5af-41c3-a868-69202e77ea1e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.225154 Aug 31 13:42:57.799414 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 340/731] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:57 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:42:57.821714 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:57.821714 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:57.822056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lazy-loading 'fault' on Instance uuid 15246791-5821-4746-ab57-de3340921964 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:42:57.865094 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '174b20d2ac0044439df2969dbc2ce325', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ae54f8b2e084475ab699677246680a5e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:57.873047 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3758831b-cd6f-400c-aa55-4f552966d49c tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 200 len: 1312 microversion: 2.1 time: 0.122504 Aug 31 13:42:57.873671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 392/732] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:57 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 1312 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:58.761095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:58.761719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:58.768459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:58.768838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:58.769633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:58.770052 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:58.825104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:58.826228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:58.834498 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:58.835241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:58.836549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:58.837209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:58.850653 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:58.859202 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-806525a2-852f-42d8-9c95-14185e5a06b7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1210 microversion: 2.1 time: 0.102145 Aug 31 13:42:58.869460 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 341/733] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:58 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1210 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:42:58.891238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:58.891846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] [instance: 15246791-5821-4746-ab57-de3340921964] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:58.898105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:58.898865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:58.900883 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:58.901339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:58.915729 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] HTTP exception thrown: Instance 15246791-5821-4746-ab57-de3340921964 could not be found. Aug 31 13:42:58.916931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] Returning 404 to user: Instance 15246791-5821-4746-ab57-de3340921964 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:42:58.918432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ac07d047-2ded-42b7-833a-7017abfab67e tempest-ServerRescueNegativeTestJSON-1458935063 tempest-ServerRescueNegativeTestJSON-1458935063-project] 10.222.0.21 "GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964" status: 404 len: 111 microversion: 2.1 time: 0.029839 Aug 31 13:42:58.918432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 342/734] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:58 2021] GET /compute/v2.1/servers/15246791-5821-4746-ab57-de3340921964 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:42:58.992045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:59.001966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:59.003835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:42:59.005016 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c113d057-4a36-444c-8b10-b39d4f904b25 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.184146 Aug 31 13:42:59.005580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 393/735] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:42:58 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:42:59.880507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:42:59.880507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:42:59.887366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:59.887815 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:42:59.888636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:42:59.889129 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:00.024962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:00.025788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:00.032604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:00.033024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:00.034033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:00.034464 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:00.188346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:00.200048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:00.202184 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:00.203477 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-686a4abb-cfcb-4058-9421-899b0f99f2c4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.182416 Aug 31 13:43:00.204693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 394/736] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:00 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:00.277071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:00.284707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-25c5d264-0c27-4bfc-b224-ad60ff7f85a0 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.411878 Aug 31 13:43:00.285276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 343/737] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:42:59 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:01.227558 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:01.228724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:01.235440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:01.236167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:01.237155 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:01.237743 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:01.301277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:01.302795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:01.318176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:01.318632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:01.319692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:01.320233 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:01.387366 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:01.395806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:01.397311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:01.399002 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0ce73a8c-ab4f-467b-838c-c8f979d9caf7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.175022 Aug 31 13:43:01.399746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 395/738] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:01 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:01.464062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-b2999407-a6bd-4dec-aaf8-5301c545a479 req-685bb963-b5da-4f55-b8ee-4cf127caf3a3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81610f93-fb19-4d2b-9ce6-2fb98e042bb8", "tag": "24a32f0b-1fb5-4a9d-88cd-93dba8debd20"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:01.466721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:43:01.466721 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:43:01.484501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-b2999407-a6bd-4dec-aaf8-5301c545a479 req-685bb963-b5da-4f55-b8ee-4cf127caf3a3 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:01.485181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-b2999407-a6bd-4dec-aaf8-5301c545a479 req-685bb963-b5da-4f55-b8ee-4cf127caf3a3 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:01.499885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-b2999407-a6bd-4dec-aaf8-5301c545a479 req-685bb963-b5da-4f55-b8ee-4cf127caf3a3 service nova] Creating event network-changed:24a32f0b-1fb5-4a9d-88cd-93dba8debd20 for instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 on hv-cinder-80660 Aug 31 13:43:01.505408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-b2999407-a6bd-4dec-aaf8-5301c545a479 req-685bb963-b5da-4f55-b8ee-4cf127caf3a3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046773 Aug 31 13:43:01.506806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 396/739] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:43:01 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:43:01.625126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:01.633333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-de3fe3fb-bbb4-46d0-a029-60bcd17580f6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.335846 Aug 31 13:43:01.634019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 344/740] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:01 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:02.162136 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f850d8dc-64b6-45a7-af50-922aaa5da965 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:02.180228 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f850d8dc-64b6-45a7-af50-922aaa5da965 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.180991 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f850d8dc-64b6-45a7-af50-922aaa5da965 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:02.249698 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f850d8dc-64b6-45a7-af50-922aaa5da965 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Going to try to stop instance {{(pid=120181) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 31 13:43:02.326144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f850d8dc-64b6-45a7-af50-922aaa5da965 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 202 len: 0 microversion: 2.1 time: 0.167851 Aug 31 13:43:02.328471 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 397/741] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:43:02 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:43:02.342817 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:02.346406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:02.362871 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.365007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:02.368262 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.374575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:02.418786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:02.419473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:02.426104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.426447 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:02.427220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.427821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:02.658066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:02.676281 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b4af4898-e8ae-42e9-aa15-c634fd74086b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.343891 Aug 31 13:43:02.677186 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 345/742] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:02 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:02.684450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:02.693440 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:02.694295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:02.695961 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:02.696101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:02.702843 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-651bac70-d43d-4637-9d62-09642bb47e33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.288074 Aug 31 13:43:02.703817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 398/743] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:02 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:43:02.709469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.709993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:02.711048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:02.711901 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:03.219892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:03.228322 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e82c357d-8d97-4336-bdb1-e1d081d20022 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.538509 Aug 31 13:43:03.238401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 346/744] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:02 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 561 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:03.694301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:03.695120 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:03.701406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:03.702027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:03.702647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:03.703080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:03.720723 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:03.722201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:03.733397 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:03.734138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:03.735080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:03.735702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:03.903678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:03.915924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:03.926403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:03.927615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1635bbcc-e122-464c-b9f9-8844e36c10bc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.210925 Aug 31 13:43:03.946545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 347/745] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:03 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:04.085982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:04.098538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5d1f2d14-9d10-4fbb-8e7e-3e31d9eaebf3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.407735 Aug 31 13:43:04.109425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 399/746] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:03 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:04.247383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:04.248658 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:04.262451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:04.263020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:04.263941 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:04.264396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:04.530668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:04.539905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ba478912-41ba-4dff-8a7d-29f2c3385b93 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.297668 Aug 31 13:43:04.540535 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 348/747] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:04 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:04.948118 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:04.948749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:04.962413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:04.963273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:04.964255 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:04.964716 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:05.102256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:05.111135 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:05.112669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:05.114321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2d3d7248-bba7-46e8-b46d-64193e824196 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.170658 Aug 31 13:43:05.118609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:05.119868 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:05.126154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:05.126608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:05.127553 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:05.127941 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:05.129374 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 400/748] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:04 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:05.267268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:05.275278 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-faf86e46-3ebb-48c6-830c-69be264855a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.160603 Aug 31 13:43:05.275906 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 349/749] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:05 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:05.556814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:05.557427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:05.563855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:05.564295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:05.565141 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:05.565510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:05.700280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:05.707973 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a44f6cbd-e152-4409-afec-317e321cda96 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.155284 Aug 31 13:43:05.708586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 401/750] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:05 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:06.134748 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:06.136271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:06.142068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-57c03511-b486-4b6e-b3b1-03b299b70b23 req-c47e74aa-5b18-4b34-999b-f8906e04c342 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "name": "network-vif-plugged", "status": "completed", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:06.143909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.144348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.144765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:43:06.144765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:43:06.145179 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.145604 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.154117 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-57c03511-b486-4b6e-b3b1-03b299b70b23 req-c47e74aa-5b18-4b34-999b-f8906e04c342 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.154871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-57c03511-b486-4b6e-b3b1-03b299b70b23 req-c47e74aa-5b18-4b34-999b-f8906e04c342 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.170626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-57c03511-b486-4b6e-b3b1-03b299b70b23 req-c47e74aa-5b18-4b34-999b-f8906e04c342 service nova] Creating event network-vif-plugged:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:43:06.176281 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-57c03511-b486-4b6e-b3b1-03b299b70b23 req-c47e74aa-5b18-4b34-999b-f8906e04c342 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039510 Aug 31 13:43:06.177274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 402/751] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:43:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:43:06.285930 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:06.294188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:06.295158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:06.295514 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:06.297087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:06.298473 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-55565996-5fb0-485f-b1d7-7992057fe36b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.168284 Aug 31 13:43:06.299199 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 350/752] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:06 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:43:06.302333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.302908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.303814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.304579 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.434906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:06.443734 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-82dacba4-273c-4f7d-9412-9485efe77aea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.154946 Aug 31 13:43:06.444311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 403/753] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:06 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:06.725930 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:06.726616 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:06.732636 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.733231 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.734017 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:06.734472 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:06.878293 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:06.887406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-56b7b06e-0f93-4fb9-8fda-4ce80385c8ee tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.165816 Aug 31 13:43:06.887989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 351/754] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:06 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:07.321450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:07.322256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:07.328927 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:07.329406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:07.330148 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:07.330577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:07.461791 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:07.462605 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:07.469119 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:07.469673 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:07.470519 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:07.471026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:07.483132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:07.491601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:07.493124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:07.494238 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1a009558-664e-430c-9895-4e4b310456a4 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.178245 Aug 31 13:43:07.494828 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 404/755] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:07 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:07.608347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:07.617342 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fac6c663-0f7d-454e-96e4-5b70ffb8203a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.159853 Aug 31 13:43:07.618023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 352/756] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:07 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:07.908589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:07.909671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:07.920274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:07.921093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:07.922455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:07.923201 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:08.071869 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:08.081580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2b67ace3-7b53-42f6-88c1-eaad98d2e67c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1278 microversion: 2.1 time: 0.179921 Aug 31 13:43:08.082282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 405/757] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:07 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1278 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:08.522097 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:08.523128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:08.531211 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:08.531844 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:08.533126 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:08.533733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:08.636526 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:08.636991 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:08.644507 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:08.645054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:08.646081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:08.646702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:08.682305 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:08.692078 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:08.693982 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:08.695468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-61b98b03-6e8a-4ece-9952-745ef23bd8a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.182314 Aug 31 13:43:08.696284 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 353/758] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:08 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:08.787495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:08.795344 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2d09a95d-c08d-42ea-aa69-51993bea6bb4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.164486 Aug 31 13:43:08.796312 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 406/759] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:08 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:09.099304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:09.099843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:09.106573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:09.107017 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:09.107787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:09.108219 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:09.247224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:09.259075 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7324f11f-a1d3-4714-829c-aff187d120af tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.163245 Aug 31 13:43:09.260515 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 354/760] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:09 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:09.716509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:09.717081 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:09.723736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:09.724186 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:09.725015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:09.725423 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:09.813693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:09.814299 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:09.820626 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:09.821060 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:09.821823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:09.822244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:09.863804 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:09.873327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:09.874825 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:09.875973 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4e21e3bd-6c1c-4f4e-955e-2bd1b48c8dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.165591 Aug 31 13:43:09.876563 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 407/761] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:09 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:09.962959 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:09.971750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-705119b8-6f56-40c0-80a3-23f4e5a564eb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.162327 Aug 31 13:43:09.972348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 355/762] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:09 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:10.283372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:10.284004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:10.291483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:10.291938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:10.292759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:10.293234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:10.427930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:10.435668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b94a3820-cff6-418c-b88a-448470894fa4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.156990 Aug 31 13:43:10.436263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 408/763] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:10 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:10.896406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:10.897068 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:10.903970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:10.904412 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:10.905224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:10.905656 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:10.989878 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:10.990743 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:10.998052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:10.998562 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:10.999408 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:10.999915 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:11.040780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:11.049909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:11.051416 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:11.053209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-df6388bd-a137-410f-a427-41a87177bb42 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.160953 Aug 31 13:43:11.058686 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 356/764] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:10 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:11.136749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:11.146651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a553ac88-8f64-4752-a897-d17c4e69abd4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.160756 Aug 31 13:43:11.147467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 409/765] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:10 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:11.452738 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:11.453326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:11.459574 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:11.460028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:11.461000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:11.461428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:11.609970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:11.618643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5b9ac098-120e-4f07-9e4b-2b4f79e572cb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.169610 Aug 31 13:43:11.619206 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 357/766] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:11 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:12.074076 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:12.074789 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:12.083580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:12.084020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:12.085199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:12.085786 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:12.165104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:12.165780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:12.172074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:12.172555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:12.173301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:12.173978 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:12.249889 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:12.262320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:12.264167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:12.265540 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3497ddc3-bf0d-4f2c-9854-5e0525e13d85 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1808 microversion: 2.20 time: 0.196549 Aug 31 13:43:12.266314 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 410/767] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:12 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1808 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:12.331842 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:12.342314 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d041886a-2841-44bf-a8f5-1aad1e1fd462 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.181053 Aug 31 13:43:12.342916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 358/768] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:12 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:12.635003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:12.635966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:12.643663 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:12.644111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:12.644933 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:12.645368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:12.778705 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:12.787218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f9c25994-9720-4db3-917a-8bfe2a043ec6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.155988 Aug 31 13:43:12.787818 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 411/769] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:12 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:13.286017 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:13.286738 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:13.294653 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:13.295132 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:13.295920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:13.296348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:13.363317 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:13.364096 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:13.372930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:13.373388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:13.374178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:13.374610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:13.458286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:13.467463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:13.469013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:13.470171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b0598f7a-cdb0-41eb-aee7-5feab6e8b37e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1795 microversion: 2.20 time: 0.188635 Aug 31 13:43:13.470769 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 359/770] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:43:13 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1795 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:43:13.513509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:13.523425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bd2b1fde-0216-4ecc-9319-9e98ec37b9ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.166093 Aug 31 13:43:13.524044 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 412/771] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:13 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:13.806793 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:13.807444 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:13.814424 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:13.814964 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:13.816067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:13.816571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:13.951019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:13.962666 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-501878af-a948-43e4-a908-14ba19d9cd5b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.160695 Aug 31 13:43:13.963408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 360/772] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:13 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:14.540258 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:14.540879 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:14.548072 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:14.548546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:14.549336 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:14.549760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:14.686187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:14.694859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ca756744-738d-4818-946a-110f1769dbb5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.158341 Aug 31 13:43:14.695467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 413/773] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:14 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:14.980299 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:14.981049 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:14.988910 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:14.989441 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:14.990308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:14.990797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:15.125123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:15.137366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f95cf512-96dd-4808-a353-8f027e0abd55 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.161433 Aug 31 13:43:15.137942 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 361/774] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:14 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:15.712522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:15.713125 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:15.719665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:15.720113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:15.720917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:15.721356 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:15.857087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:15.865903 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-62bf4b90-78ca-401c-81d3-916505a6e052 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.157294 Aug 31 13:43:15.866443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 414/775] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:15 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:16.161438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:16.162062 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:16.169799 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:16.170249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:16.171041 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:16.171475 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:16.312308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:16.324349 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b3fa2f46-3510-4bf2-8ad7-1f249a96a281 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.166930 Aug 31 13:43:16.325246 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 362/776] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:16 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:16.885851 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:16.887160 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:16.894631 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:16.895572 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:16.896566 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:16.897084 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:17.039495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:17.048394 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7cb33d06-521b-433d-89a8-77ed5810238e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.167908 Aug 31 13:43:17.049056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 415/777] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:16 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:17.341875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:17.342452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:17.348810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:17.349257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:17.350060 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:17.350495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:17.483042 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:17.490717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1167a386-6fa5-4335-a72b-97031e971241 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.152722 Aug 31 13:43:17.491287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 363/778] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:17 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:18.066482 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:18.067082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:18.073050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:18.073540 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:18.074524 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:18.074955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:18.218718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:18.226887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f7c274a8-d41a-49ab-9183-dc05eb6bcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.164160 Aug 31 13:43:18.227419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 416/779] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:18 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:18.507351 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:18.507896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:18.514719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:18.515162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:18.515929 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:18.516360 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:18.645884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:18.657290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-acc0fc53-e69e-4fc4-bfea-564dcb063ee9 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.153523 Aug 31 13:43:18.658130 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 364/780] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:18 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:19.244063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:19.244770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:19.251419 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:19.251925 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:19.252731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:19.253168 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:19.391074 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:19.400708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-50969299-346a-413d-9efc-a517c85b3e27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.160963 Aug 31 13:43:19.401314 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 417/781] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:19 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:19.682324 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:19.683108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:19.690087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:19.690541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:19.691297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:19.691843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:19.842843 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:19.851734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2b7ce1ac-301e-484b-a595-3b3468b634fd tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.173910 Aug 31 13:43:19.852318 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 365/782] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:19 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:20.418644 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:20.419269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:20.425602 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:20.426014 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:20.426800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:20.427232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:20.553882 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:20.561797 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-12ed8f27-7c1b-47c7-9e90-5d38fd4b65e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.147296 Aug 31 13:43:20.562397 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 418/783] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:20 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:20.877022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:20.878402 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:20.890198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:20.893488 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:20.895371 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:20.896809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:21.050303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:21.060960 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-55778c8b-91df-45ce-81b2-52200cee19a7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.193119 Aug 31 13:43:21.066778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 366/784] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:20 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:21.579033 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:21.579630 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:21.588060 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:21.588735 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:21.589859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:21.590293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:21.737682 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:21.747069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-04596c75-2032-4206-9634-277ddb3c2214 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.171860 Aug 31 13:43:21.747668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 419/785] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:21 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:22.078737 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:22.079336 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:22.085693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:22.086134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:22.086923 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:22.087334 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:22.223807 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:22.232428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7cfb8c70-e98c-4150-b8c3-444ffad38239 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.157344 Aug 31 13:43:22.232963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 367/786] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:22 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:22.766452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:22.767051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:22.773460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:22.773902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:22.774783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:22.775203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:22.907826 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:22.919283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5f074442-6e9f-475b-8339-264ecbd08837 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.157652 Aug 31 13:43:22.920116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 420/787] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:22 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:23.259698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:23.260344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:23.267321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:23.267768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:23.268607 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:23.269043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:23.375179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:23.375660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:23.384331 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:23.384806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:23.385954 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:23.386507 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:23.406739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:23.414310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1531ca8d-9961-4198-9a7e-679220f2e633 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.160259 Aug 31 13:43:23.414893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 368/788] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:23 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:23.471978 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lazy-loading 'services' on Instance uuid 2321f757-4259-4311-aa8c-d0e3598f91b5 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:43:23.545107 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b7b0ef87-0cd7-4906-8515-a6700514566b tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5/os-volume_attachments/5b9ef497-c63d-4c5f-9012-82a2466dcbe6" status: 202 len: 0 microversion: 2.1 time: 0.173587 Aug 31 13:43:23.545856 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 421/789] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:43:23 2021] DELETE /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5/os-volume_attachments/5b9ef497-c63d-4c5f-9012-82a2466dcbe6 => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:43:23.936996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:23.937614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:23.943631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:23.944064 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:23.944883 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:23.945312 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.090365 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:24.100494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-88dab33f-dee9-45f1-aa10-62b96e66ffc3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.167390 Aug 31 13:43:24.101815 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 369/790] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:23 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:24.238187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-1cb6d28f-bdc7-410d-b753-f37454730368 req-7d03ca8c-dc9f-431c-896b-3b8cb5ac0afa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81610f93-fb19-4d2b-9ce6-2fb98e042bb8", "name": "network-vif-plugged", "status": "completed", "tag": "24a32f0b-1fb5-4a9d-88cd-93dba8debd20"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:24.239712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:43:24.239712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:43:24.247144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-1cb6d28f-bdc7-410d-b753-f37454730368 req-7d03ca8c-dc9f-431c-896b-3b8cb5ac0afa service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.247573 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-1cb6d28f-bdc7-410d-b753-f37454730368 req-7d03ca8c-dc9f-431c-896b-3b8cb5ac0afa service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.258740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-1cb6d28f-bdc7-410d-b753-f37454730368 req-7d03ca8c-dc9f-431c-896b-3b8cb5ac0afa service nova] Creating event network-vif-plugged:24a32f0b-1fb5-4a9d-88cd-93dba8debd20 for instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 on hv-cinder-80660 Aug 31 13:43:24.264439 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-1cb6d28f-bdc7-410d-b753-f37454730368 req-7d03ca8c-dc9f-431c-896b-3b8cb5ac0afa service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030180 Aug 31 13:43:24.265097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 422/791] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:43:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:43:24.434136 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:24.434876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:24.441218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.441661 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.442436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.442867 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.578295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:24.585955 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-258681e0-a7a8-4416-af73-9e87fab35179 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.157273 Aug 31 13:43:24.586534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 370/792] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:24 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:24.675990 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:24.676842 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:24.684224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.684702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.685484 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.685921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.711391 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:43:24.795079 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2c770b26-341c-4bf4-9adb-91e6724aa905 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "DELETE /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 204 len: 0 microversion: 2.1 time: 0.123662 Aug 31 13:43:24.795755 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 423/793] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:43:24 2021] DELETE /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:43:24.804418 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:24.805036 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:24.811434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.811891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.812783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:24.813128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:24.947646 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:24.955857 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-33448e47-05d9-49cb-ab60-4cacf60250b9 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1513 microversion: 2.1 time: 0.155551 Aug 31 13:43:24.956549 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 371/794] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:24 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1513 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:25.118941 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:25.119625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:25.126071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:25.126522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:25.127303 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:25.127730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:25.266368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:25.278324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b24dcca3-d60e-447e-a3ab-1eb007219c7c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.163629 Aug 31 13:43:25.278909 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 424/795] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:25 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:25.606309 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:25.606958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:25.613659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:25.614088 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:25.614877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:25.615308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:25.753839 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:25.765840 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f5084e71-647d-42b9-833a-11d4c47d9662 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1266 microversion: 2.1 time: 0.165028 Aug 31 13:43:25.766461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 372/796] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:25 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:25.976501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:25.977268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:25.986454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:25.986967 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:25.988203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:25.989078 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:26.129244 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:26.137756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f8e1dfed-ca7a-4179-ab05-790513c9b473 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1513 microversion: 2.1 time: 0.167373 Aug 31 13:43:26.138366 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 425/797] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:25 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1513 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:26.296099 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:26.296746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:26.302763 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:26.303210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:26.304223 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:26.304680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:26.438909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:26.447301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-719f256d-877d-4148-aa73-2d58dbe826a3 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.155121 Aug 31 13:43:26.447771 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 373/798] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:26 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:26.784578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:26.785130 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:26.791138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:26.791639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:26.792322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:26.792765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:26.988066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:26.996246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-797760f3-1663-4cf9-8b4c-0e59ce34bff5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1452 microversion: 2.1 time: 0.215952 Aug 31 13:43:26.997205 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 426/799] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:26 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1452 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:27.013511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:27.014323 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:27.020084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.020581 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.021370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.021802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.155116 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:27.155958 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:27.156640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:27.162262 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.162768 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.163621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.164010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-01b4334e-1a37-49f4-84f3-0c25cef2ab92 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1452 microversion: 2.1 time: 0.154902 Aug 31 13:43:27.164149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.165235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 374/800] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:27 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1452 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:27.365007 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dfba192291f64cab941d1006c81380bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5651d65709fb486eb25e57054dc889cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:27.376567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6fbf311c-bcaa-4dc0-bc95-e102c8ed4388 tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 200 len: 1513 microversion: 2.1 time: 0.225243 Aug 31 13:43:27.377462 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 427/801] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:27 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 1513 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:43:27.468969 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-541c1cbb-fc13-4c51-8f45-45fdd55d0ba8 req-da332663-5c23-4a59-8a95-595759c36c6a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2321f757-4259-4311-aa8c-d0e3598f91b5", "name": "network-vif-deleted", "tag": "8e244733-f35a-470a-9e05-32c5b1061ef6"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:27.470531 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:43:27.470531 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:43:27.476585 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:27.477494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:27.478496 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-541c1cbb-fc13-4c51-8f45-45fdd55d0ba8 req-da332663-5c23-4a59-8a95-595759c36c6a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.478934 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-541c1cbb-fc13-4c51-8f45-45fdd55d0ba8 req-da332663-5c23-4a59-8a95-595759c36c6a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.484708 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.485576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.486367 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:27.489043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:27.506610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-541c1cbb-fc13-4c51-8f45-45fdd55d0ba8 req-da332663-5c23-4a59-8a95-595759c36c6a service nova] Creating event network-vif-deleted:8e244733-f35a-470a-9e05-32c5b1061ef6 for instance 2321f757-4259-4311-aa8c-d0e3598f91b5 on hv-cinder-80660 Aug 31 13:43:27.513415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-541c1cbb-fc13-4c51-8f45-45fdd55d0ba8 req-da332663-5c23-4a59-8a95-595759c36c6a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047537 Aug 31 13:43:27.514614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 428/802] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:43:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:43:27.755098 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:27.766718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7210a894-0ac7-442f-9af4-0e828197acca tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1721 microversion: 2.1 time: 0.305260 Aug 31 13:43:27.767743 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 375/803] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:27 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:28.394744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:28.395399 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] [instance: 2321f757-4259-4311-aa8c-d0e3598f91b5] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:28.402603 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:28.403232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:28.404020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:28.404473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:28.418810 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] HTTP exception thrown: Instance 2321f757-4259-4311-aa8c-d0e3598f91b5 could not be found. Aug 31 13:43:28.419381 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] Returning 404 to user: Instance 2321f757-4259-4311-aa8c-d0e3598f91b5 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:43:28.420232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-59e794e9-e84b-4a91-a59f-a4528b46b37d tempest-VolumesSnapshotTestJSON-87477101 tempest-VolumesSnapshotTestJSON-87477101-project] 10.222.0.21 "GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5" status: 404 len: 111 microversion: 2.1 time: 0.029610 Aug 31 13:43:28.420848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 429/804] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:28 2021] GET /compute/v2.1/servers/2321f757-4259-4311-aa8c-d0e3598f91b5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:43:28.784477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:28.785379 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:28.796151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:28.796151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:28.796151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:28.796151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:29.031576 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:29.040865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-44656004-eb41-4dcb-a241-813a8a092c34 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1698 microversion: 2.1 time: 0.260195 Aug 31 13:43:29.041587 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 376/805] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:28 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1698 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:29.058440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bfb1b9b6-b7a6-4c64-bf6c-f137ec318e43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:29.065096 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bfb1b9b6-b7a6-4c64-bf6c-f137ec318e43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:29.065650 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bfb1b9b6-b7a6-4c64-bf6c-f137ec318e43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:29.092550 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bfb1b9b6-b7a6-4c64-bf6c-f137ec318e43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Going to try to start instance {{(pid=120181) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 31 13:43:29.151962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bfb1b9b6-b7a6-4c64-bf6c-f137ec318e43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 202 len: 0 microversion: 2.1 time: 0.097425 Aug 31 13:43:29.152664 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 430/806] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:43:29 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:43:29.161810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:29.162832 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:29.172146 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:29.172641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:29.173504 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:29.174194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:29.604810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:29.613652 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-20318c27-559c-416a-a992-c4596ab6be20 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1707 microversion: 2.1 time: 0.456242 Aug 31 13:43:29.614406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 377/807] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:29 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1707 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:29.733290 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-0a3c368e-9c61-417b-979d-26729da834d3 req-f3fcb5d5-2bc3-438b-a198-104bd22ede90 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81610f93-fb19-4d2b-9ce6-2fb98e042bb8", "tag": "24a32f0b-1fb5-4a9d-88cd-93dba8debd20"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:43:29.735290 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:43:29.735290 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:43:29.747381 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-0a3c368e-9c61-417b-979d-26729da834d3 req-f3fcb5d5-2bc3-438b-a198-104bd22ede90 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:29.747919 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-0a3c368e-9c61-417b-979d-26729da834d3 req-f3fcb5d5-2bc3-438b-a198-104bd22ede90 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:29.760000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-0a3c368e-9c61-417b-979d-26729da834d3 req-f3fcb5d5-2bc3-438b-a198-104bd22ede90 service nova] Creating event network-changed:24a32f0b-1fb5-4a9d-88cd-93dba8debd20 for instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 on hv-cinder-80660 Aug 31 13:43:29.765891 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-0a3c368e-9c61-417b-979d-26729da834d3 req-f3fcb5d5-2bc3-438b-a198-104bd22ede90 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038507 Aug 31 13:43:29.766645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 431/808] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:43:29 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:43:30.631706 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:30.632321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:30.639582 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:30.640064 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:30.640934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:30.641357 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:30.776588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:30.784796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c2b06a56-93f1-440f-867c-4e2cc3e0684f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1707 microversion: 2.1 time: 0.156947 Aug 31 13:43:30.785381 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 378/809] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:30 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1707 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:31.802967 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:31.803552 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:31.812217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:31.812803 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:31.814056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:31.814689 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:31.948149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:31.957127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a01ddc68-1413-4536-b944-4da7aa612eec tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1707 microversion: 2.1 time: 0.158264 Aug 31 13:43:31.957709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 432/810] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:31 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:32.975108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:32.975722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:32.983225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:32.983664 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:32.984485 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:32.984878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:33.122944 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:33.131408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-144c6928-9a44-49cc-bd7b-78aa082fc61a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1707 microversion: 2.1 time: 0.160053 Aug 31 13:43:33.132024 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 379/811] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:32 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:43:34.150932 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:43:34.151567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:43:34.158161 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:34.158617 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:34.159388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:43:34.159823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:43:34.314926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:43:34.325224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-972a8c65-ee33-4213-9872-95880d2ec1c6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1711 microversion: 2.1 time: 0.178766 Aug 31 13:43:34.325941 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 433/812] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:43:34 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1711 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:01.254365 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:01.255345 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:01.263289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:01.264075 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:01.265090 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:01.265615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:01.307609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c5c26b9f-ffff-4fb2-adf4-d8d95197f74a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments/eafc86dc-fc13-4b5f-a91f-1bb7b56d1afa" status: 200 len: 194 microversion: 2.20 time: 0.057974 Aug 31 13:44:01.308841 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 380/813] 10.222.0.21 () {60 vars in 1454 bytes} [Tue Aug 31 13:44:01 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments/eafc86dc-fc13-4b5f-a91f-1bb7b56d1afa => generated 194 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:44:01.421549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:01.422650 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:01.434008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:01.434706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:01.435657 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:01.436071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:01.803752 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lazy-loading 'services' on Instance uuid 37ca962d-2198-4c40-ac9b-6ab316ebc725 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:44:01.887330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-82c2ccd3-1827-4527-8be9-82b2087a8377 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments/eafc86dc-fc13-4b5f-a91f-1bb7b56d1afa" status: 202 len: 0 microversion: 2.20 time: 0.470207 Aug 31 13:44:01.888040 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 434/814] 10.222.0.21 () {60 vars in 1457 bytes} [Tue Aug 31 13:44:01 2021] DELETE /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments/eafc86dc-fc13-4b5f-a91f-1bb7b56d1afa => generated 0 bytes in 472 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:44:01.897369 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:01.898559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:01.904812 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:01.905267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:01.906051 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:01.906478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:01.943082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b7127b6a-18df-48c3-9c2d-7c8f464adf59 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050096 Aug 31 13:44:01.947297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 381/815] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 31 13:44:01 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:44:02.956811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:02.958288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:02.968110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:02.968968 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:02.970287 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:02.970912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:03.044977 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bf2e6d48-7c5a-414b-8154-7567e2c8141e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.092483 Aug 31 13:44:03.045790 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 435/816] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 31 13:44:02 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments => generated 197 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:44:04.058853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:04.059891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:04.068632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:04.069985 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:04.071981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:04.074185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:04.142676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-da276473-8bfd-4240-86e5-4368a9933df9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.088282 Aug 31 13:44:04.151878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 382/817] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 31 13:44:04 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments => generated 197 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:44:05.165135 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:05.166066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:05.176567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:05.177445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:05.178706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:05.179909 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:05.221991 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4be6ac2c-30fd-4217-bc7b-b18761c5a1d2 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.063712 Aug 31 13:44:05.227178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 436/818] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 31 13:44:05 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:44:06.241068 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:06.243435 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:06.267551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:06.268268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:06.276029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:06.278631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:06.315093 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-dda05141-eeec-48c4-8b5f-0678afa20dd8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.083242 Aug 31 13:44:06.316159 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 383/819] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 31 13:44:06 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725/os-volume_attachments => generated 25 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:06.402238 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:06.403818 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:06.410992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:06.411708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:06.412840 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:06.413699 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:06.473406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:44:06.655759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-240a8664-6395-4a46-b95a-9fe9cb11077a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 204 len: 0 microversion: 2.20 time: 0.257143 Aug 31 13:44:06.659759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 437/820] 10.222.0.21 () {60 vars in 1280 bytes} [Tue Aug 31 13:44:06 2021] DELETE /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:44:06.667813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:06.668468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:06.682611 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:06.683174 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:06.684025 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:06.684599 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:07.261339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:07.271445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:07.273823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:07.275449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cb00ffca-651d-4744-9975-19e293d2508f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.611582 Aug 31 13:44:07.277023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 384/821] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:06 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:08.305584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:08.307975 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:08.325937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:08.327584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:08.328550 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:08.329274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:08.527430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:08.543521 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:08.546076 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:08.548642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ccceaf77-9f9d-4483-b5a3-baa120d6aa70 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1723 microversion: 2.20 time: 0.257104 Aug 31 13:44:08.549430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 438/822] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:08 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1723 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:09.568249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:09.569115 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:09.583792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:09.584234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:09.585102 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:09.585716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:09.822506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:09.838371 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:09.841384 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:09.843683 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3d0cc737-1b8b-483a-9499-2dc0617addc9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 200 len: 1656 microversion: 2.20 time: 0.279434 Aug 31 13:44:09.849539 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 385/823] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:09 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 1656 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:10.192523 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-c752bf43-174e-424d-baf1-e14fb015a597 req-2839f78b-4061-49b9-8acc-053e55f41a98 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "37ca962d-2198-4c40-ac9b-6ab316ebc725", "name": "network-vif-deleted", "tag": "4210618e-d4b5-4d63-a60a-038ee73a1bab"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:10.194328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:10.194328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:44:10.211739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-c752bf43-174e-424d-baf1-e14fb015a597 req-2839f78b-4061-49b9-8acc-053e55f41a98 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:10.212207 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-c752bf43-174e-424d-baf1-e14fb015a597 req-2839f78b-4061-49b9-8acc-053e55f41a98 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:10.259122 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-c752bf43-174e-424d-baf1-e14fb015a597 req-2839f78b-4061-49b9-8acc-053e55f41a98 service nova] Creating event network-vif-deleted:4210618e-d4b5-4d63-a60a-038ee73a1bab for instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 on hv-cinder-80660 Aug 31 13:44:10.265521 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-c752bf43-174e-424d-baf1-e14fb015a597 req-2839f78b-4061-49b9-8acc-053e55f41a98 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080482 Aug 31 13:44:10.266831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 439/824] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:44:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:44:10.866443 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:10.867303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:10.887265 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:10.888850 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:10.900083 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:10.900585 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:10.932548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] HTTP exception thrown: Instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 could not be found. Aug 31 13:44:10.933151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Returning 404 to user: Instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:44:10.935775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-277ad972-733c-41aa-8de8-e8a7eae7dd33 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 404 len: 111 microversion: 2.20 time: 0.071749 Aug 31 13:44:10.936390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 386/825] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:10 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 111 bytes in 75 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:44:10.945584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-58e28937-2ebc-452c-b9f7-ecf17b39f37a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '.version_select at 0x7f67f43b21f0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:10.981610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-58e28937-2ebc-452c-b9f7-ecf17b39f37a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071530075" status: 204 len: 0 microversion: 2.20 time: 0.040067 Aug 31 13:44:10.982271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 440/826] 10.222.0.21 () {60 vars in 1262 bytes} [Tue Aug 31 13:44:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2071530075 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:44:12.355498 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4e58e3fd-7ebe-4cb4-8475-c8ffb1fca8c9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'create', calling method: .version_select at 0x7f67f4bd3af0>, body: {"keypair": {"name": "tempest-keypair-809990844"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:12.391625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-4e58e3fd-7ebe-4cb4-8475-c8ffb1fca8c9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:44:12.396928 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-4e58e3fd-7ebe-4cb4-8475-c8ffb1fca8c9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for user efd51ea7f4e849538be43d6164cb1a30 and project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:44:13.094356 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-4e58e3fd-7ebe-4cb4-8475-c8ffb1fca8c9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:44:13.099745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-4e58e3fd-7ebe-4cb4-8475-c8ffb1fca8c9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for user efd51ea7f4e849538be43d6164cb1a30 and project ed036eb1dc894a28af566c40419db15a. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:44:13.131558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4e58e3fd-7ebe-4cb4-8475-c8ffb1fca8c9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 201 len: 2315 microversion: 2.20 time: 0.781672 Aug 31 13:44:13.132178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 387/827] 10.222.0.21 () {62 vars in 1199 bytes} [Tue Aug 31 13:44:12 2021] POST /compute/v2.1/os-keypairs => generated 2315 bytes in 783 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:44:15.329536 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1242126026", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2963958-fdd6-40d3-96f2-9d73522bf15e"}], "security_groups": [{"name": "tempest-securitygroup--314718040"}], "key_name": "tempest-keypair-809990844", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:15.452218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] validate_networks() for [('e2963958-fdd6-40d3-96f2-9d73522bf15e', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:44:16.193310 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:44:16.194032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:44:16.194234 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:44:16.194867 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:44:16.195456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:44:16.213143 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:16.214012 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:16.215034 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:16.215480 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:16.216288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:16.216768 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:16.223162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:16.228781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:16.230642 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:16.231478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:16.241621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for project ed036eb1dc894a28af566c40419db15a. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:44:16.248056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Getting quotas for user efd51ea7f4e849538be43d6164cb1a30 and project ed036eb1dc894a28af566c40419db15a. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:44:16.265749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:44:16.269330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:44:16.353087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-974aa9c8-2a2d-4114-8b87-8858d9a8c86e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.027503 Aug 31 13:44:16.368430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 441/828] 10.222.0.21 () {62 vars in 1188 bytes} [Tue Aug 31 13:44:15 2021] POST /compute/v2.1/servers => generated 401 bytes in 1044 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 31 13:44:16.433378 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lazy-loading 'services' on Instance uuid 600915c4-ecf3-4004-8c57-260a462152a7 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:44:16.548048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-13fbb956-3aad-44d1-b89f-857219ad33c2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-volume_attachments/ea704a35-1084-4eed-9e21-4b1863d08cb8" status: 202 len: 0 microversion: 2.1 time: 0.337986 Aug 31 13:44:16.550057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 388/829] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:44:16 2021] DELETE /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-volume_attachments/ea704a35-1084-4eed-9e21-4b1863d08cb8 => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:16.615964 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c55ee90e-6c58-4095-9e4f-e8b3fb1128fc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:16.618021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c55ee90e-6c58-4095-9e4f-e8b3fb1128fc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:16.760551 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c55ee90e-6c58-4095-9e4f-e8b3fb1128fc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:16.776007 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c55ee90e-6c58-4095-9e4f-e8b3fb1128fc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:16.785144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c55ee90e-6c58-4095-9e4f-e8b3fb1128fc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:16.788973 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c55ee90e-6c58-4095-9e4f-e8b3fb1128fc tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1281 microversion: 2.20 time: 0.417931 Aug 31 13:44:16.790051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 442/830] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:16 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1281 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:17.813565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:17.814603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:17.825483 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:17.826306 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:17.827548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:17.828173 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:17.868505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b06c2e89-e3c1-448f-9f4c-df2090438519 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:17.881122 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b06c2e89-e3c1-448f-9f4c-df2090438519 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:17.881955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b06c2e89-e3c1-448f-9f4c-df2090438519 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:17.915907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b06c2e89-e3c1-448f-9f4c-df2090438519 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Going to try to stop instance {{(pid=120181) force_stop /opt/stack/nova/nova/compute/api.py:2615}} Aug 31 13:44:17.954123 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:17.970143 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:17.972921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b06c2e89-e3c1-448f-9f4c-df2090438519 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 202 len: 0 microversion: 2.1 time: 0.108334 Aug 31 13:44:17.973326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:17.975223 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f2aca1ce-e86d-475a-82fd-2ec9c97d13f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1333 microversion: 2.20 time: 0.166434 Aug 31 13:44:17.976145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 389/831] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:17 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1333 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:17.984916 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 443/832] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:44:17 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:17.994579 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:17.999566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:18.017609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:18.020087 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:18.021114 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:18.024089 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:18.518344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:18.531016 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6c2f3591-03ec-47ca-a1f8-9551342c7f4b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.540247 Aug 31 13:44:18.532544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 390/833] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:17 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:19.007866 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:19.011822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:19.019267 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:19.020005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:19.021822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:19.023780 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:19.116841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:19.127641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:19.130626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:19.135953 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c9c498f0-b168-4a34-b999-603d7c1ac82f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1339 microversion: 2.20 time: 0.142707 Aug 31 13:44:19.137710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 444/834] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:18 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1339 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:44:19.549578 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:19.550183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:19.567521 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:19.568406 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:19.569876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:19.571059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:19.916065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:19.932294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a71fee68-aa7a-4aa7-81b4-792264bc2007 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.386320 Aug 31 13:44:19.933034 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 391/835] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:19 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:20.155216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:20.155814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:20.166499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:20.168070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:20.168070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:20.168847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:20.395464 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:20.412916 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:20.416253 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:20.418501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9ed563a3-f1be-4b3a-a74c-87bec6b84f7d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.267353 Aug 31 13:44:20.422697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 445/836] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:20 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:20.961092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:20.962571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:20.970220 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:20.970916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:20.972330 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:20.973438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:21.362386 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-c6e48c35-6183-4a90-a4d5-f5ce9b5fab6e req-00c9d9ce-bdbf-49d1-a393-e2c45568a335 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:21.364859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:21.364859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:44:21.374156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-c6e48c35-6183-4a90-a4d5-f5ce9b5fab6e req-00c9d9ce-bdbf-49d1-a393-e2c45568a335 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:21.374807 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-c6e48c35-6183-4a90-a4d5-f5ce9b5fab6e req-00c9d9ce-bdbf-49d1-a393-e2c45568a335 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:21.386888 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-c6e48c35-6183-4a90-a4d5-f5ce9b5fab6e req-00c9d9ce-bdbf-49d1-a393-e2c45568a335 service nova] Creating event network-changed:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:44:21.392363 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-c6e48c35-6183-4a90-a4d5-f5ce9b5fab6e req-00c9d9ce-bdbf-49d1-a393-e2c45568a335 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.376052 Aug 31 13:44:21.393813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 446/837] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:44:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:21.416914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:21.432571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f0de34e9-083e-414d-b7aa-809bdad53e60 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.481599 Aug 31 13:44:21.433218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 392/838] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:20 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:21.458730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:21.459442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:21.466192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:21.466640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:21.467432 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:21.467857 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:21.705775 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:21.718323 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:21.720452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:21.721777 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-591252d0-c069-4734-b0a6-f6d9fb82feaf tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.272542 Aug 31 13:44:21.735058 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 447/839] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:21 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:22.452019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:22.452019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:22.470337 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:22.470807 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:22.471615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:22.472051 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:22.744202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:22.745439 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:22.756280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:22.756280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:22.759433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:22.763293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:22.907459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:22.921282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d5ca3352-0977-49dd-b97d-cee7cf0c8479 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.473869 Aug 31 13:44:22.923966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 393/840] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:22 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:23.079749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:23.109649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:23.111766 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:23.120256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-36f79c85-1f9f-4a79-b4aa-66c07321fdb0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.373922 Aug 31 13:44:23.121619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 448/841] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:22 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:44:23.944020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:23.944856 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:23.953752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:23.954198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:23.960308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:23.961133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:24.139110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:24.139722 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:24.160248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:24.160532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:24.160769 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:24.161563 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:24.161994 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:24.177727 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e8b659f1-17fd-4e4b-9579-aae2aa2c8660 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.239992 Aug 31 13:44:24.189081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 394/842] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:23 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:24.369303 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:24.379490 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:24.381502 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:24.385652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e540c688-707d-4f3b-94dd-da42998223f5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.248482 Aug 31 13:44:24.386824 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 449/843] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:24 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:25.195971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:25.197433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:25.204770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:25.205232 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:25.206488 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:25.206647 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:25.380847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:25.393581 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3ae20ca4-dc3f-4bab-8db0-9542762d644f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.202153 Aug 31 13:44:25.403559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 395/844] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:25 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:25.404198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:25.404829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:25.414465 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:25.416278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:25.418387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:25.419060 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:25.580816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:25.603973 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:25.608260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:25.609893 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d062da3e-81c1-4e77-9552-fd186f280c9a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.209249 Aug 31 13:44:25.611025 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 450/845] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:25 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:26.411175 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:26.412456 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:26.426559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:26.432572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:26.433619 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:26.434053 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:26.641079 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:26.642527 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:26.651519 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:26.652209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:26.653472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:26.654051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:26.680125 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:26.688794 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9e906ad2-2536-4149-84d4-2283a35d0aab tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.281347 Aug 31 13:44:26.692839 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 396/846] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:26 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:26.706251 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-77fc2c9a-910f-43e1-95bc-791de075e0a7 req-185a3c33-9281-43af-bc21-af7aca19e20d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "name": "network-vif-plugged", "status": "completed", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:26.707833 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:26.707833 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:44:26.725156 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-77fc2c9a-910f-43e1-95bc-791de075e0a7 req-185a3c33-9281-43af-bc21-af7aca19e20d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:26.725580 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-77fc2c9a-910f-43e1-95bc-791de075e0a7 req-185a3c33-9281-43af-bc21-af7aca19e20d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:26.739834 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-77fc2c9a-910f-43e1-95bc-791de075e0a7 req-185a3c33-9281-43af-bc21-af7aca19e20d service nova] Creating event network-vif-plugged:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:44:26.750612 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-77fc2c9a-910f-43e1-95bc-791de075e0a7 req-185a3c33-9281-43af-bc21-af7aca19e20d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053082 Aug 31 13:44:26.751837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 397/847] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:44:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:26.921557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:26.930653 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:26.932706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:26.933950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a5bc1194-32b1-4aaf-a5b7-d6100de78c86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.307395 Aug 31 13:44:26.934587 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 451/848] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:26 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:27.711550 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:27.712408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:27.721486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:27.722421 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:27.723528 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:27.724156 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:27.877219 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:27.889610 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-10cd602a-eab9-45fe-b624-844dfc493b4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1675 microversion: 2.1 time: 0.182041 Aug 31 13:44:27.891198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 398/849] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:27 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1675 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:27.951737 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:27.953305 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:27.962143 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:27.962744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:27.963739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:27.964241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:28.123219 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:28.135102 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:28.136808 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:28.138232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2203b6b8-cdbb-45f8-a294-41ebc6747efe tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1406 microversion: 2.20 time: 0.190905 Aug 31 13:44:28.138868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 452/850] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:27 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1406 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:28.906805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:28.907419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:28.914020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:28.914472 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:28.915262 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:28.915711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:28.971673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2429de33-5888-40d2-bc06-2499aa5cd6a0 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Action: 'create', calling method: .version_select at 0x7f67f43b2f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-447308117"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:28.991042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-2429de33-5888-40d2-bc06-2499aa5cd6a0 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Getting quotas for project 60c6a57cd6ad45bfa5a8e6639416cc35. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:44:28.995459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-2429de33-5888-40d2-bc06-2499aa5cd6a0 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Getting quotas for user f4da27ae43cd4d5daab0dbdf31437832 and project 60c6a57cd6ad45bfa5a8e6639416cc35. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:44:29.049569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:29.057067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-729289f2-60dd-4297-a555-156efb4e474d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1652 microversion: 2.1 time: 0.154125 Aug 31 13:44:29.057654 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 399/851] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:28 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1652 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:29.073453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-36901b84-dd92-4fc7-bb63-15e66201466e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:29.080350 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-36901b84-dd92-4fc7-bb63-15e66201466e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.080925 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-36901b84-dd92-4fc7-bb63-15e66201466e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.141877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-36901b84-dd92-4fc7-bb63-15e66201466e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Going to try to start instance {{(pid=120180) start /opt/stack/nova/nova/compute/api.py:2638}} Aug 31 13:44:29.186783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-2429de33-5888-40d2-bc06-2499aa5cd6a0 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Getting quotas for project 60c6a57cd6ad45bfa5a8e6639416cc35. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:44:29.187108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-36901b84-dd92-4fc7-bb63-15e66201466e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action" status: 202 len: 0 microversion: 2.1 time: 0.117155 Aug 31 13:44:29.187963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 400/852] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:44:29 2021] POST /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:44:29.190893 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-2429de33-5888-40d2-bc06-2499aa5cd6a0 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Getting quotas for user f4da27ae43cd4d5daab0dbdf31437832 and project 60c6a57cd6ad45bfa5a8e6639416cc35. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:44:29.194167 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:29.194865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:29.202107 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.202559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.203327 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.204031 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.204388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2429de33-5888-40d2-bc06-2499aa5cd6a0 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2317 microversion: 2.1 time: 0.236405 Aug 31 13:44:29.205007 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 453/853] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 31 13:44:28 2021] POST /compute/v2.1/os-keypairs => generated 2317 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:29.218946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:29.219577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:29.227616 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.228062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.229041 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.229482 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.375434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:29.383454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-547c84a3-4cd4-45c6-9719-3d061038dcf6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1661 microversion: 2.1 time: 0.170023 Aug 31 13:44:29.384035 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 454/854] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:29 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1661 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:29.388506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1770589851", "imageRef": "dd17fc0d-1972-425d-83cd-1402f5362205", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-447308117", "networks": [{"uuid": "ef158fed-9340-45d9-8a62-fca3c70447b0"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:29.442153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] validate_networks() for [('ef158fed-9340-45d9-8a62-fca3c70447b0', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:44:29.449196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:29.457478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:29.458983 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:29.460283 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-48ff8838-8b03-42da-9ce6-b5ca4e86a8b1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1598 microversion: 2.20 time: 0.271067 Aug 31 13:44:29.461079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 401/855] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:44:29 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1598 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:44:29.478278 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:29.479226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:29.485333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.485788 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.486566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:29.486999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:29.599510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-acba5921-5d6f-47e6-9f11-f7a71bd1372a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.125458 Aug 31 13:44:29.601841 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 402/856] 10.222.0.21 () {60 vars in 1316 bytes} [Tue Aug 31 13:44:29 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-interface => generated 285 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:44:30.192684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:44:30.193192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:44:30.193650 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:44:30.194064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:44:30.194468 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:44:30.204972 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:30.205333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:30.206335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:30.206778 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:30.224921 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Getting quotas for project 60c6a57cd6ad45bfa5a8e6639416cc35. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:44:30.229140 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Getting quotas for user f4da27ae43cd4d5daab0dbdf31437832 and project 60c6a57cd6ad45bfa5a8e6639416cc35. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:44:30.239856 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:44:30.242265 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd17fc0d-1972-425d-83cd-1402f5362205',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:44:30.289111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-34bbf106-ea43-4b93-bd77-72fc3456546e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.903918 Aug 31 13:44:30.290206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 455/857] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:44:29 2021] POST /compute/v2.1/servers => generated 380 bytes in 906 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:44:30.300220 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5374a053-5341-48e2-a0a6-5c73b4b048c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:30.300991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5374a053-5341-48e2-a0a6-5c73b4b048c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:30.363179 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5374a053-5341-48e2-a0a6-5c73b4b048c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:30.371831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5374a053-5341-48e2-a0a6-5c73b4b048c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1258 microversion: 2.1 time: 0.075288 Aug 31 13:44:30.372574 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 403/858] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:30 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1258 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:30.403240 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:30.404227 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:30.413823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:30.414593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:30.415573 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:30.416150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:30.669636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:30.677841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-23c4763e-33da-457e-9a0e-0509eb8905a2 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1661 microversion: 2.1 time: 0.280154 Aug 31 13:44:30.678914 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 456/859] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:30 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1661 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:30.934963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:30.937614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:30.944839 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:30.945294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:30.946061 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:30.946562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:31.019037 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f7b6e4cb-e5ae-4bd0-ad8a-35ef3dec02d8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 14 microversion: 2.20 time: 0.092721 Aug 31 13:44:31.023168 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 404/860] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:30 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:31.071623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-00eec724-bd89-4485-9f3c-0dcae30c6879 req-291f79ba-cd81-4402-8b6e-948c174c4db2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:31.073517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:31.073517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:44:31.080802 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-00eec724-bd89-4485-9f3c-0dcae30c6879 req-291f79ba-cd81-4402-8b6e-948c174c4db2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:31.081231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-00eec724-bd89-4485-9f3c-0dcae30c6879 req-291f79ba-cd81-4402-8b6e-948c174c4db2 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:31.092286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-00eec724-bd89-4485-9f3c-0dcae30c6879 req-291f79ba-cd81-4402-8b6e-948c174c4db2 service nova] Creating event network-changed:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:44:31.097619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-00eec724-bd89-4485-9f3c-0dcae30c6879 req-291f79ba-cd81-4402-8b6e-948c174c4db2 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.168328 Aug 31 13:44:31.098250 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 457/861] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:44:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:31.390996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:31.392309 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:31.408569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:31.409034 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:31.409869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:31.410291 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:31.536431 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:31.554269 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9df6605d-b0d5-464b-a13d-17fb7ca5b8b5 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1318 microversion: 2.1 time: 0.167764 Aug 31 13:44:31.558371 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 405/862] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:31 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:31.711908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:31.716273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:31.739009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:31.740872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:31.745509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:31.746986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:32.030848 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:32.031913 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:32.041295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:32.041759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:32.042563 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:32.042996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:32.107632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:32.122792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f8752520-89fe-460c-9698-5833ae5c7b24 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 14 microversion: 2.20 time: 0.095714 Aug 31 13:44:32.124924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 406/863] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:32 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 14 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:32.127911 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9b2483e0-cf9b-4707-8740-59e1a6667f58 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1665 microversion: 2.1 time: 0.430546 Aug 31 13:44:32.128532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 458/864] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:31 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1665 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:32.583423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:32.591354 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:32.615724 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:32.616242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:32.624626 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:32.629541 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:32.930853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:32.945618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-56208961-cbb6-4006-962f-ad481773b4bc tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.371337 Aug 31 13:44:32.956506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 407/865] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:32 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:33.136099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:33.137389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:33.143876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:33.144334 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:33.145149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:33.145578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:33.966442 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:33.967169 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:33.973842 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:33.974285 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:33.975242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:33.975569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:34.163201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:34.171361 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-58f6a661-6f25-427c-b564-985f578451c4 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.209079 Aug 31 13:44:34.171951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 408/866] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:33 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:35.188775 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:35.189511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:35.206193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:35.206638 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:35.207648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:35.208082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:35.383015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:35.391033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5c6b2729-fe61-4922-8994-0ab715be0024 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.206116 Aug 31 13:44:35.401497 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 409/867] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:35 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:36.409389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:36.410109 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:36.417223 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:36.417671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:36.419479 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:36.419779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:36.553338 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:36.561491 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7ed1264e-cc78-4658-bcf5-27ff6f8bcb89 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.156161 Aug 31 13:44:36.562090 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 410/868] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:36 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:37.579250 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:37.579991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:37.585912 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:37.586323 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:37.587065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:37.587500 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:37.755486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:37.765289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-423d8cc7-2c4d-4a03-86fd-29bea910ab49 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.190058 Aug 31 13:44:37.766159 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 411/869] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:37 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:38.783148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:38.783911 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:38.791150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:38.791875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:38.792900 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:38.793404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:38.932464 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:38.939853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4019e40c-ee68-4d78-b7d4-6f181a588510 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.160524 Aug 31 13:44:38.940735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 412/870] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:38 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:39.957378 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:39.958095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:39.965387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:39.965828 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:39.966626 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:39.967057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:40.095439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:40.103366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e7da956b-a389-4d2f-9349-4600586e9f77 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.149811 Aug 31 13:44:40.103952 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 413/871] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:39 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:41.122286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:41.123772 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:41.135685 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:41.136400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:41.137388 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:41.137826 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:41.282555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:41.292215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b4784f4e-1125-42d0-9516-bd72370ddf80 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.175423 Aug 31 13:44:41.292887 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 414/872] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:41 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:42.310369 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:42.311124 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:42.318575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:42.319026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:42.319810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:42.320237 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:42.455059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:42.466205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-478f3f5d-1414-4722-85fd-4cbd35d6ed3e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.159637 Aug 31 13:44:42.466805 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 415/873] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:42 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:44:43.004525 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6e3d4a1-b876-43d0-8c66-920f5a6e1eba] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 13:44:43.484756 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:43.485393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:43.492548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:43.493033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:43.493835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:43.494295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:43.632451 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:43.640776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-753b54b4-8b0d-4967-9a24-c0840f51310c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.159955 Aug 31 13:44:43.641397 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 416/874] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:43 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:44.040957 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6e3d4a1-b876-43d0-8c66-920f5a6e1eba] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 47494. Aug 31 13:44:44.048476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ae848df3-6ad8-4270-a96e-7a35d2e46b46 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 18305 microversion: 2.20 time: 10.917001 Aug 31 13:44:44.050268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 459/875] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:33 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 18305 bytes in 10919 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:44.206654 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-da18552b-dd19-4d53-a1c1-31f086397265 req-f36b58b9-64a3-4f24-84b0-913286ce478e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:44.208316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:44.208316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:44:44.234287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-da18552b-dd19-4d53-a1c1-31f086397265 req-f36b58b9-64a3-4f24-84b0-913286ce478e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:44.234730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-da18552b-dd19-4d53-a1c1-31f086397265 req-f36b58b9-64a3-4f24-84b0-913286ce478e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:44.252632 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-da18552b-dd19-4d53-a1c1-31f086397265 req-f36b58b9-64a3-4f24-84b0-913286ce478e service nova] Creating event network-changed:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:44:44.259510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-da18552b-dd19-4d53-a1c1-31f086397265 req-f36b58b9-64a3-4f24-84b0-913286ce478e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062782 Aug 31 13:44:44.260317 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 417/876] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:44:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:44.658960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:44.659651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:44.667167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:44.667604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:44.668454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:44.668870 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:44.889043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:44.897692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ddf6aa9d-5cb0-4ea8-a835-6a8f2915187a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.242503 Aug 31 13:44:44.898645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 460/877] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:44 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:45.061348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:45.062375 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:45.069391 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:45.069837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:45.070924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:45.071390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:45.157780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-eef1c86d-f0a2-49f5-a4ef-c64b3d972648 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 19722 microversion: 2.20 time: 0.100240 Aug 31 13:44:45.158510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 418/878] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:45 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 19722 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:45.915548 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:45.916276 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:45.922924 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:45.923407 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:45.924184 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:45.924655 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:46.059428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:46.068621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-35ebf581-e20b-4c54-b407-0f07c3e9bdd7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.157277 Aug 31 13:44:46.069387 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 461/879] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:45 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:46.174154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:46.175762 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:46.187439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:46.187896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:46.188719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:46.189157 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:46.270963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e5b8ca54-4163-4a29-95a9-2929811264b3 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 22119 microversion: 2.20 time: 0.103634 Aug 31 13:44:46.272076 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 419/880] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:46 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 22119 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:47.086545 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:47.087232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:47.093570 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:47.094013 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:47.094811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:47.095217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:47.236216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:47.244750 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d03e3430-2351-4451-afc9-8026ba41ab60 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.162794 Aug 31 13:44:47.245488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 462/881] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:47 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:47.283395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:47.284420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:47.291714 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:47.292172 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:47.292984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:47.293417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:47.370597 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-87876643-ab98-4444-82d9-c8bc709ffe04 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 23442 microversion: 2.20 time: 0.091407 Aug 31 13:44:47.371439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 420/882] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:47 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 23442 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:48.264358 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:48.264993 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:48.271950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:48.272393 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:48.273176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:48.273902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:48.384183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:48.385219 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:48.392279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:48.392754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:48.393525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:48.393950 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:48.411932 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:48.419473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-80168e9b-5809-41cc-841d-693f9f21b8b3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.158996 Aug 31 13:44:48.420068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 463/883] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:48 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:48.466480 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-59fd9284-c18e-439e-974f-9f37545bef73 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 24978 microversion: 2.20 time: 0.086661 Aug 31 13:44:48.467207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 421/884] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:48 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 24978 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:49.437364 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:49.438129 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:49.446363 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:49.447147 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:49.447980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:49.448407 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:49.479816 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:49.480853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:49.488651 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:49.489280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:49.490155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:49.490714 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:49.576315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-86463eb8-b8e7-4927-b1c2-9cb72f5f3237 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 26152 microversion: 2.20 time: 0.100990 Aug 31 13:44:49.580962 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 422/885] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:49 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 26152 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:49.587820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:49.599086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ef921d0c-92fb-4656-9ae3-12bf2d0932bd tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.166186 Aug 31 13:44:49.600086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 464/886] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:49 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:50.589172 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:50.590171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:50.598389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:50.598837 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:50.599615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:50.600051 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:50.623237 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:50.624069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:50.630939 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:50.631512 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:50.632353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:50.632872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:50.683261 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c1d48765-f3dd-42d4-8635-73b872149f6e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 27179 microversion: 2.20 time: 0.098350 Aug 31 13:44:50.688117 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 423/887] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:50 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 27179 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:50.787470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:50.796059 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4e6fa0f3-8b23-4cb3-b83f-465daa49c28c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.179248 Aug 31 13:44:50.796533 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 465/888] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:50 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:50.917633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-1bbe845b-ffe5-46d3-88d8-2a1c441d17e5 req-055f49f6-afcc-4dbf-a43a-0096226d5001 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "name": "network-vif-plugged", "status": "completed", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:50.919166 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:50.919166 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:44:50.926789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-1bbe845b-ffe5-46d3-88d8-2a1c441d17e5 req-055f49f6-afcc-4dbf-a43a-0096226d5001 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:50.927235 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-1bbe845b-ffe5-46d3-88d8-2a1c441d17e5 req-055f49f6-afcc-4dbf-a43a-0096226d5001 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:50.938476 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-1bbe845b-ffe5-46d3-88d8-2a1c441d17e5 req-055f49f6-afcc-4dbf-a43a-0096226d5001 service nova] Creating event network-vif-plugged:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:44:50.943452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-1bbe845b-ffe5-46d3-88d8-2a1c441d17e5 req-055f49f6-afcc-4dbf-a43a-0096226d5001 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.236327 Aug 31 13:44:50.944092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 424/889] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:44:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:51.699678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:51.700667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:51.708077 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:51.708544 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:51.709287 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:51.709729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:51.792506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8ff15af8-af52-494d-937b-4c55e302c801 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 27796 microversion: 2.20 time: 0.097584 Aug 31 13:44:51.793039 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 466/890] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:51 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 27796 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:51.814128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:51.814825 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:51.821390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:51.821859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:51.822627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:51.823055 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:51.972295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:51.985193 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5b26762e-4f15-45f1-80ba-9cd4a5c946c1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1358 microversion: 2.1 time: 0.175185 Aug 31 13:44:51.986271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 425/891] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:51 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:52.807468 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:52.809072 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:52.816628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:52.817052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:52.817868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:52.818296 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:52.899956 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9528bec2-5c57-45b7-99a5-4376e07d495d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28084 microversion: 2.20 time: 0.098252 Aug 31 13:44:52.900634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 467/892] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:52 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28084 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:53.005029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:53.006013 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:53.013244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.013712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.014620 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.014872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.150088 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:53.159341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-33a4b8f5-ced8-4f37-8c69-b24207bd3068 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1548 microversion: 2.1 time: 0.157970 Aug 31 13:44:53.159954 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 426/893] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:52 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:53.177306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:53.178062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:53.187461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.188085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.189293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.189821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.321571 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:53.329682 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-598f279c-1b64-4e8a-ba34-a386be339f64 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1548 microversion: 2.1 time: 0.156893 Aug 31 13:44:53.330255 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 468/894] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:53 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1548 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:53.345853 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:53.349196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:44:53.349196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:44:53.350166 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:53.350944 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Searching by: {'deleted': False, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35'} {{(pid=120180) get_all /opt/stack/nova/nova/compute/api.py:2868}} Aug 31 13:44:53.358101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.358531 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.359310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.359739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.462644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.multi_cell_list [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120180) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 31 13:44:53.565014 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b1ab4db5-37fc-4f7d-bd51-836fd48afaa7 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.222552 Aug 31 13:44:53.565599 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 427/895] 10.222.0.21 () {58 vars in 1125 bytes} [Tue Aug 31 13:44:53 2021] GET /compute/v2.1/servers => generated 343 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:53.576277 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:44:53.576930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:53.583576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.584019 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.584854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.585282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.716747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:44:53.726011 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-26fa7620-c04b-41a4-9249-f95be1e9dcd9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1548 microversion: 2.1 time: 0.153468 Aug 31 13:44:53.727010 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 469/896] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:44:53 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1548 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:44:53.913380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:53.914401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:53.922916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.923269 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:53.924054 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:53.924523 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:54.000693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7e25f1bd-dafb-4563-95ab-031845609dad tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28227 microversion: 2.20 time: 0.091452 Aug 31 13:44:54.004990 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 428/897] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:53 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28227 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:55.013329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:55.014268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:55.021180 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:55.021628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:55.022384 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:55.022814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:55.092756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8290645f-e3a9-4384-b818-a23749fcb77b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28227 microversion: 2.20 time: 0.083158 Aug 31 13:44:55.093418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 470/898] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:55 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28227 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:55.356390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ae29258-01f6-4ed9-9c55-24051a7b79b5"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:55.357657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:55.364760 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:55.365209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:55.365974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:55.366376 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:55.642057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6e9f681a-85ee-4778-9081-21fa3df424be tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.289781 Aug 31 13:44:55.642733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 429/899] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:44:55 2021] POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments => generated 194 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:44:56.107610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:56.108591 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:56.115495 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:56.116012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:56.116811 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:56.117246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:56.205695 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c993dd0b-6996-48e2-9945-e17ec2bd850d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28518 microversion: 2.20 time: 0.103326 Aug 31 13:44:56.206241 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 471/900] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:56 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28518 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:57.220002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:57.221079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:57.228945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:57.229529 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:57.230303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:57.230732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:57.316426 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a8d7c561-0ecc-4741-b855-3761784a1b83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28571 microversion: 2.20 time: 0.100883 Aug 31 13:44:57.317090 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 430/901] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:57 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28571 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:58.329539 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:58.330469 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:58.337442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:58.337875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:58.338651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:58.339072 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:58.428967 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-335501b3-d2d5-4a70-8c32-0b48a07d0e15 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28685 microversion: 2.20 time: 0.103441 Aug 31 13:44:58.429619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 472/902] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:58 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28685 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:44:59.444643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:44:59.446212 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:44:59.455857 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:59.456441 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:59.457609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:44:59.458024 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:44:59.524718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1e365da2-5bd8-4593-a9a0-8be7342a561c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28685 microversion: 2.20 time: 0.086465 Aug 31 13:44:59.525348 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 431/903] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:44:59 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28685 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:00.538236 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:00.539226 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:00.546771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:00.547212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:00.547982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:00.548416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:00.615256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-977e9588-da78-4cd8-9102-a00abcbfa5c7 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 28685 microversion: 2.20 time: 0.080717 Aug 31 13:45:00.615983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 473/904] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:00 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 28685 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:01.630344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:01.631495 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:01.639796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:01.640326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:01.641270 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:01.641778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:01.735404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-aed33c95-1d2a-4628-887e-77cae10ae919 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 29849 microversion: 2.20 time: 0.110093 Aug 31 13:45:01.736255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 432/905] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:01 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 29849 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:02.749102 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:02.750215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:02.758027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:02.758537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:02.759378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:02.759852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:02.841054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b9070e67-9623-40d5-8808-d645ee50d5aa tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 31511 microversion: 2.20 time: 0.096255 Aug 31 13:45:02.841834 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 474/906] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:02 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 31511 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:03.295704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:03.296453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:03.303602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:03.304031 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:03.304862 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:03.305294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:03.441229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:03.452234 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2dda0f4e-c39a-4c59-9b4d-62a399028484 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1594 microversion: 2.1 time: 0.160833 Aug 31 13:45:03.453032 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 433/907] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:03 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1594 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:03.854263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:03.855664 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:03.864017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:03.864493 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:03.865274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:03.865806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:03.950061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-3da98fe4-2520-44a1-95d4-021e4e743178 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 32726 microversion: 2.20 time: 0.100054 Aug 31 13:45:03.951223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 475/908] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:03 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 32726 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:04.962213 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:04.963196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:04.970141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:04.970710 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:04.971661 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:04.972145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:05.050698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cb80d966-3e9c-47ab-9e9c-5b4b7fa27518 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 33628 microversion: 2.20 time: 0.092194 Aug 31 13:45:05.051350 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 434/909] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:04 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 33628 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:05.375127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-8fcd97e2-fecb-4700-a04a-6d4a083300c8 req-54b366c8-7b5a-45f4-a653-79008b538d4a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:05.376697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:05.376697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:05.384879 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-8fcd97e2-fecb-4700-a04a-6d4a083300c8 req-54b366c8-7b5a-45f4-a653-79008b538d4a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:05.385328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-8fcd97e2-fecb-4700-a04a-6d4a083300c8 req-54b366c8-7b5a-45f4-a653-79008b538d4a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:05.397450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-8fcd97e2-fecb-4700-a04a-6d4a083300c8 req-54b366c8-7b5a-45f4-a653-79008b538d4a service nova] Creating event network-changed:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:45:05.402657 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-8fcd97e2-fecb-4700-a04a-6d4a083300c8 req-54b366c8-7b5a-45f4-a653-79008b538d4a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032075 Aug 31 13:45:05.406610 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 476/910] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:06.066308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:06.067982 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:06.076413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:06.077403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:06.078604 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:06.079436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:06.179608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9bee273b-94f0-49cb-b88b-bf6238b4138e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 34583 microversion: 2.20 time: 0.119766 Aug 31 13:45:06.185681 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 435/911] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:06 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 34583 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:06.716609 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1111256055"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:06.717225 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:06.723371 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:06.723817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:06.724627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:06.725058 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:06.854486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.network.security_group_api [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Adding security group 232c62aa-9a66-4647-812e-4b51d79a469e to port 34eff954-6b81-42e0-814c-eed66d639575 Aug 31 13:45:07.193842 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:07.194890 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:07.202468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.202934 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.203733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.204643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.223036 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fe3185e3-a0f0-40db-832b-3a8086f81fa1 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/action" status: 202 len: 0 microversion: 2.1 time: 0.511054 Aug 31 13:45:07.224661 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 477/912] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:06 2021] POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/action => generated 0 bytes in 514 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:07.237275 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-8fa5d72e-6208-4870-976e-7f5c02c0f6fd req-951b0f7f-2d11-4e9a-8f23-132d9557d230 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:07.239433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:07.239433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:07.249744 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-8fa5d72e-6208-4870-976e-7f5c02c0f6fd req-951b0f7f-2d11-4e9a-8f23-132d9557d230 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.250959 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-8fa5d72e-6208-4870-976e-7f5c02c0f6fd req-951b0f7f-2d11-4e9a-8f23-132d9557d230 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.267939 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-8fa5d72e-6208-4870-976e-7f5c02c0f6fd req-951b0f7f-2d11-4e9a-8f23-132d9557d230 service nova] Creating event network-changed:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:45:07.273595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-8fa5d72e-6208-4870-976e-7f5c02c0f6fd req-951b0f7f-2d11-4e9a-8f23-132d9557d230 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042742 Aug 31 13:45:07.274762 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 478/913] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:07.281338 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:07.282121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:07.289169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.289769 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.290738 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.291302 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.306052 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-589ed289-4a7c-4c07-82cc-e527c3b07751 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 35413 microversion: 2.20 time: 0.116397 Aug 31 13:45:07.306840 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 436/914] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:07 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 35413 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 31 13:45:07.446656 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:07.456784 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f68b5d19-fdc8-4136-80c6-4e020559a52c tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1759 microversion: 2.1 time: 0.180607 Aug 31 13:45:07.457633 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 479/915] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:07 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:07.702783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:07.704276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:07.712328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.712989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.713865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.714530 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.753659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-036661bf-c148-48aa-98f3-3a38114eb94f tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056733 Aug 31 13:45:07.759651 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 437/916] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:45:07 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:07.826363 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:07.827449 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:07.834021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.834576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.835443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.835938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.864717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:45:07.956901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a6747373-35ca-4702-a05d-b8a4e0a9e8ae tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 204 len: 0 microversion: 2.1 time: 0.134220 Aug 31 13:45:07.957497 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 480/917] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:45:07 2021] DELETE /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:45:07.966339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:07.966985 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:07.973462 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.973975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:07.974779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:07.975215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:08.118192 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:08.129820 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d70cef82-b12e-4a49-b071-5ceb987f9f01 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1671 microversion: 2.1 time: 0.166964 Aug 31 13:45:08.130678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 438/918] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:07 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1671 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:45:08.319928 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:08.321005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:08.327936 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:08.328416 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:08.329191 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:08.329623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:08.417460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b2207345-4a27-4660-afd6-575628a595e9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 36532 microversion: 2.20 time: 0.101798 Aug 31 13:45:08.418285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 481/919] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:08 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 36532 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:09.151659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:09.152603 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:09.160112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:09.160618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:09.161386 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:09.161820 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:09.287498 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:09.295987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e2562950-bbed-425b-bde6-2bc1480f2775 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1671 microversion: 2.1 time: 0.150623 Aug 31 13:45:09.296602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 439/920] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:09 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:09.433778 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:09.434948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:09.441860 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:09.442307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:09.443080 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:09.443514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:09.531336 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5efe2c45-f77b-4863-ae6a-686f54f8a0e8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 37627 microversion: 2.20 time: 0.102047 Aug 31 13:45:09.532008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 482/921] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:09 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 37627 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:10.316194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:10.316807 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:10.327019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:10.327470 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:10.328255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:10.328717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:10.545134 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:10.546148 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:10.553508 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:10.553945 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:10.554728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:10.555158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:10.643340 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-27eb9f84-344e-4f97-a206-702d4be020f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 38240 microversion: 2.20 time: 0.102427 Aug 31 13:45:10.644017 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 483/922] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:10 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 38240 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:10.776704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:10.784783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5bee3aef-af5a-447d-9b70-84f97b8a18e0 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1671 microversion: 2.1 time: 0.474393 Aug 31 13:45:10.785410 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 440/923] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:10 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1671 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:11.559577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-7e7b652a-6a76-4570-8b59-5a3aee4296ed req-76b808c9-4163-4b44-b86a-0659272fecbf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "600915c4-ecf3-4004-8c57-260a462152a7", "name": "network-vif-deleted", "tag": "abeb489f-0045-481c-8ee8-424a975cb388"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:11.561337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:11.561337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:11.569852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-7e7b652a-6a76-4570-8b59-5a3aee4296ed req-76b808c9-4163-4b44-b86a-0659272fecbf service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:11.570816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-7e7b652a-6a76-4570-8b59-5a3aee4296ed req-76b808c9-4163-4b44-b86a-0659272fecbf service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:11.585469 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-7e7b652a-6a76-4570-8b59-5a3aee4296ed req-76b808c9-4163-4b44-b86a-0659272fecbf service nova] Creating event network-vif-deleted:abeb489f-0045-481c-8ee8-424a975cb388 for instance 600915c4-ecf3-4004-8c57-260a462152a7 on hv-cinder-80660 Aug 31 13:45:11.590859 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-7e7b652a-6a76-4570-8b59-5a3aee4296ed req-76b808c9-4163-4b44-b86a-0659272fecbf service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035349 Aug 31 13:45:11.591691 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 484/924] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:11.657886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:11.659207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:11.667802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:11.668350 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:11.670151 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:11.670676 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:11.746479 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2d7182e4-25bf-4c54-a646-5fe503bec467 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 38240 microversion: 2.20 time: 0.094417 Aug 31 13:45:11.747177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 441/925] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:11 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 38240 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:11.803248 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:11.803942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:11.810432 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:11.810880 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:11.811658 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:11.812089 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:11.843244 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:11.843755 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:11.844097 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lazy-loading 'fault' on Instance uuid 600915c4-ecf3-4004-8c57-260a462152a7 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:45:11.901687 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:11.910284 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4bd24950-e96f-4b78-88f0-7743191803ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 200 len: 1326 microversion: 2.1 time: 0.111153 Aug 31 13:45:11.910907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 485/926] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:11 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 1326 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:12.759723 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:12.760752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:12.768795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:12.769366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:12.770127 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:12.770448 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:12.836814 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e66ce059-e121-48cf-bf6d-63c340ca5706 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 38240 microversion: 2.20 time: 0.080950 Aug 31 13:45:12.837510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 442/927] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:12 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 38240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:12.931068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:12.932018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:12.939848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:12.940327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:12.941139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:12.941583 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:12.955642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] HTTP exception thrown: Instance 600915c4-ecf3-4004-8c57-260a462152a7 could not be found. Aug 31 13:45:12.956232 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Returning 404 to user: Instance 600915c4-ecf3-4004-8c57-260a462152a7 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:45:12.957099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-87e757a4-3117-4543-9c26-eb2fd54d5429 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 404 len: 111 microversion: 2.1 time: 0.032111 Aug 31 13:45:12.957647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 486/928] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:12 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:45:12.967494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1b13a752-8308-43fb-a935-6e464b7349d6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '.version_select at 0x7f67f4b75670>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:12.991703 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1b13a752-8308-43fb-a935-6e464b7349d6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-933173224" status: 202 len: 0 microversion: 2.1 time: 0.028686 Aug 31 13:45:12.992280 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 443/929] 10.222.0.21 () {58 vars in 1218 bytes} [Tue Aug 31 13:45:12 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-933173224 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:13.711532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cf12458f-cae0-41de-8538-a2d8c0e3d764 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: .version_select at 0x7f67f4408e50>, body: {"keypair": {"name": "tempest-keypair-1392998516"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:13.729823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cf12458f-cae0-41de-8538-a2d8c0e3d764 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:45:13.734127 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cf12458f-cae0-41de-8538-a2d8c0e3d764 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for user aaf0bbd19382494aa7e4c3dc4cb976d9 and project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:45:13.849410 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:13.850445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:13.858279 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:13.858722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:13.859522 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:13.859948 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:13.932974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-aae3c1f0-b611-4e9e-b18e-15eea56fda13 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 200 len: 38383 microversion: 2.20 time: 0.087126 Aug 31 13:45:13.933569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 444/930] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:13 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 38383 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:13.944428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:13.944993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:13.953284 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:13.953725 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:13.954558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:13.954968 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:13.983919 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-082287c9-bc75-4017-b11a-9a75c667a7fd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/ips" status: 200 len: 151 microversion: 2.20 time: 0.043456 Aug 31 13:45:13.984633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 445/931] 10.222.0.21 () {60 vars in 1289 bytes} [Tue Aug 31 13:45:13 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:14.060111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cf12458f-cae0-41de-8538-a2d8c0e3d764 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:45:14.063823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-cf12458f-cae0-41de-8538-a2d8c0e3d764 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for user aaf0bbd19382494aa7e4c3dc4cb976d9 and project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'key_pairs'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:45:14.078071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cf12458f-cae0-41de-8538-a2d8c0e3d764 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.370260 Aug 31 13:45:14.083799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 487/932] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 31 13:45:13 2021] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:15.565619 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1786911232", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9ac58f34-a341-48d5-804c-8e4590340424"}], "security_groups": [{"name": "tempest-securitygroup--198511182"}], "key_name": "tempest-keypair-1392998516", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:15.677484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] validate_networks() for [('9ac58f34-a341-48d5-804c-8e4590340424', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:45:16.130003 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:45:16.130424 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:45:16.130902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:45:16.131305 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:45:16.131709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:45:16.142209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:16.142758 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:16.143708 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:16.144289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:16.162915 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:45:16.167347 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Getting quotas for user aaf0bbd19382494aa7e4c3dc4cb976d9 and project effc0a7a4ced437a90c0e75a20033c1e. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:45:16.180161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:45:16.182600 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:45:16.232902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: ERROR oslo.messaging._drivers.impl_rabbit [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [097690c0-ea04-47c2-ab32-8a75cb52adb5] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:45:16.281872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:16.282559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:16.291034 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:16.291484 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:16.292264 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:16.292730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:16.316155 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lazy-loading 'flavor' on Instance uuid 394c001c-7443-4fbe-9741-08c461d452f0 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:45:16.598646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cf0d4640-9057-4a5c-8560-18671318d602 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 202 len: 0 microversion: 2.20 time: 0.321290 Aug 31 13:45:16.599509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 488/933] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:16 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:45:16.607636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:16.608293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:16.614878 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:16.615692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:16.616464 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:16.616986 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:16.743056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:16.751598 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:16.759469 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:16.761066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b57ce84f-a4cf-405b-94f1-18fb785c3c66 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.157324 Aug 31 13:45:16.761639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 489/934] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:16 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:17.256261 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [097690c0-ea04-47c2-ab32-8a75cb52adb5] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 47784. Aug 31 13:45:17.261252 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ae43f6cf-cc78-4f09-9129-3c77059d6573 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.702026 Aug 31 13:45:17.262048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 446/935] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:45:15 2021] POST /compute/v2.1/servers => generated 401 bytes in 1704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:45:17.273841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-055e8bd7-046a-48f7-bb30-2c3a475e1378 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:17.274542 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-055e8bd7-046a-48f7-bb30-2c3a475e1378 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:17.333208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-055e8bd7-046a-48f7-bb30-2c3a475e1378 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:17.339765 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-055e8bd7-046a-48f7-bb30-2c3a475e1378 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1238 microversion: 2.1 time: 0.070522 Aug 31 13:45:17.340530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 490/936] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:17 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1238 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:17.785538 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:17.786161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:17.793485 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:17.794084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:17.795225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:17.795648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:17.931663 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:17.939811 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:17.941313 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:17.942434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4d296ad4-2daa-4d77-a747-19b5e1af12f0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.161103 Aug 31 13:45:17.943005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 447/937] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:17 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:18.358935 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:18.360265 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:18.366546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:18.366992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:18.367782 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:18.368214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:18.442056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:18.449581 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a478d255-5067-4126-8185-bd72550fcc22 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1296 microversion: 2.1 time: 0.094864 Aug 31 13:45:18.450273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 491/938] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:18 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1296 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:18.961082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:18.961690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:18.975366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:18.975780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:18.976932 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:18.977350 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:19.194736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:19.203801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:19.205455 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:19.206631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6011fd8c-3c94-411c-908b-38f47f32b438 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.249900 Aug 31 13:45:19.207197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 448/939] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:18 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:19.468703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:19.469327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:19.483422 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:19.483865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:19.484719 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:19.485981 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:19.781827 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-6c2e6582-3607-4341-b12d-cf5a383a647c req-5a9fe931-a54e-4006-b0ea-553f2c8f02c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91", "tag": "63dd5148-73a2-4a63-82b7-9ff29b225fee"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:19.785799 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:19.785799 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:45:19.801043 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-6c2e6582-3607-4341-b12d-cf5a383a647c req-5a9fe931-a54e-4006-b0ea-553f2c8f02c3 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:19.802308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-6c2e6582-3607-4341-b12d-cf5a383a647c req-5a9fe931-a54e-4006-b0ea-553f2c8f02c3 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:19.829835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-6c2e6582-3607-4341-b12d-cf5a383a647c req-5a9fe931-a54e-4006-b0ea-553f2c8f02c3 service nova] Creating event network-changed:63dd5148-73a2-4a63-82b7-9ff29b225fee for instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 on hv-cinder-80660 Aug 31 13:45:19.839601 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-6c2e6582-3607-4341-b12d-cf5a383a647c req-5a9fe931-a54e-4006-b0ea-553f2c8f02c3 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067867 Aug 31 13:45:19.841648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 449/940] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:19 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:19.925639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:19.934841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ef043e54-d88a-4e71-a00d-175fc3f13bde tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1363 microversion: 2.1 time: 0.470085 Aug 31 13:45:19.943385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 492/941] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:19 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1363 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:20.226276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:20.227219 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:20.234526 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:20.234964 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:20.235746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:20.236173 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:20.409399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:20.418278 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:20.420886 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:20.422242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-55c7ce2c-463c-4aab-821d-fcb3e234608d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.200860 Aug 31 13:45:20.422797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 450/942] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:20 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:20.952041 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:20.952697 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:20.959417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:20.959852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:20.960654 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:20.961076 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:21.090045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:21.098390 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-be1e4b24-8764-4544-9035-c2f5f80e1f2e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1363 microversion: 2.1 time: 0.150180 Aug 31 13:45:21.098975 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 493/943] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:20 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:21.441098 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:21.441664 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:21.448351 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:21.448825 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:21.449644 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:21.450099 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:21.587548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:21.600155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:21.602617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:21.604417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-442102c0-e641-46e7-8fae-6846adaa01e5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.166842 Aug 31 13:45:21.605248 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 451/944] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:21 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:22.122686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:22.123313 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:22.129858 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:22.130307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:22.131087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:22.131526 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:22.261196 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:22.269161 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-78cb6cf2-67e5-45e0-9ac2-9e611c582f05 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1363 microversion: 2.1 time: 0.151796 Aug 31 13:45:22.269748 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 494/945] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:22 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:22.626071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:22.627077 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:22.634906 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:22.635364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:22.636132 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:22.636559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:22.773453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:22.783573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:22.785605 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:22.786908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a9bcb8bf-5607-4657-8c75-5bbe0e6000f8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.166711 Aug 31 13:45:22.787610 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 452/946] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:22 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:23.286534 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:23.287159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:23.294263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:23.294774 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:23.295593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:23.296126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:23.458254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:23.468798 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-01b8e961-c44c-49a8-8ae9-ece788b832bc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1363 microversion: 2.1 time: 0.185969 Aug 31 13:45:23.470137 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 495/947] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:23 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1363 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:23.807434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:23.808056 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:23.816578 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:23.817022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:23.817821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:23.818307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:23.969271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:23.980975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:23.982599 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:23.983803 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0484927a-0ea5-4edf-ac9b-569b2ae3439a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.180234 Aug 31 13:45:23.984390 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 453/948] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:23 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:24.495800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:24.496473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:24.505217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:24.505674 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:24.506473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:24.506901 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:24.657980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:24.668835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-99700aaa-f2be-423f-afb5-b21199a0e9d7 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1363 microversion: 2.1 time: 0.177123 Aug 31 13:45:24.669294 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 496/949] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:24 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:24.847054 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-d0305203-4fc0-4082-8b1e-1c27a94bd22d req-bf338319-56e4-4ee2-b537-9266e3ad9e04 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91", "name": "network-vif-plugged", "status": "completed", "tag": "63dd5148-73a2-4a63-82b7-9ff29b225fee"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:24.848779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:24.848779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:45:24.856855 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-d0305203-4fc0-4082-8b1e-1c27a94bd22d req-bf338319-56e4-4ee2-b537-9266e3ad9e04 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:24.857489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-d0305203-4fc0-4082-8b1e-1c27a94bd22d req-bf338319-56e4-4ee2-b537-9266e3ad9e04 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:24.874422 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-d0305203-4fc0-4082-8b1e-1c27a94bd22d req-bf338319-56e4-4ee2-b537-9266e3ad9e04 service nova] Creating event network-vif-plugged:63dd5148-73a2-4a63-82b7-9ff29b225fee for instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 on hv-cinder-80660 Aug 31 13:45:24.892185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-d0305203-4fc0-4082-8b1e-1c27a94bd22d req-bf338319-56e4-4ee2-b537-9266e3ad9e04 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048730 Aug 31 13:45:24.893951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 454/950] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:25.004681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:25.005347 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:25.013284 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:25.013780 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:25.014837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:25.015417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:25.171326 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:25.179220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:25.180725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:25.181873 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-74d13fe3-39a0-4aed-b35e-1f8708b96596 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.182067 Aug 31 13:45:25.182421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 497/951] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:24 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:25.687681 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:25.688408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:25.695072 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:25.695504 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:25.696282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:25.696736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:25.850379 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:25.859809 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4a79a05f-7342-439e-8aaa-3eda119c676b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1363 microversion: 2.1 time: 0.177222 Aug 31 13:45:25.860423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 455/952] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:25 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1363 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:26.205410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:26.206114 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:26.216634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:26.217251 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:26.218159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:26.218591 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:26.372873 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:26.389050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:26.391396 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:26.392665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8626b473-c388-4222-9beb-a302245d808b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.193753 Aug 31 13:45:26.393169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 498/953] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:26 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:26.878821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:26.879385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:26.886343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:26.886795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:26.887568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:26.888000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:27.023247 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:27.032408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7f572db5-19d3-4f31-9a98-0c2d61204a12 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1550 microversion: 2.1 time: 0.157864 Aug 31 13:45:27.033278 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 456/954] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:26 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1550 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:27.051724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:27.052418 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:27.060646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:27.061577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:27.062345 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:27.062775 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:27.160157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-11d2c51e-583b-45fe-9674-fe9279abbd5e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.113923 Aug 31 13:45:27.161027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 499/955] 10.222.0.21 () {58 vars in 1275 bytes} [Tue Aug 31 13:45:27 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:45:27.411660 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:27.412113 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:27.419401 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:27.419838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:27.420795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:27.421359 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:27.567920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:27.576655 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:27.578161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:27.579321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-79636f5b-5f9b-483d-9ac8-022a283f2999 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.171662 Aug 31 13:45:27.579912 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 457/956] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:27 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:28.272056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:28.273230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:28.274502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-6e42ee55-01e3-48af-8465-5bdfce8e74fc req-98fd13d6-4101-4dfd-b38e-14a129e9814d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91", "tag": "63dd5148-73a2-4a63-82b7-9ff29b225fee"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:28.276492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:28.276492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:45:28.280420 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:28.281168 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:28.281983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:28.282397 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:28.283896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-6e42ee55-01e3-48af-8465-5bdfce8e74fc req-98fd13d6-4101-4dfd-b38e-14a129e9814d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:28.284332 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-6e42ee55-01e3-48af-8465-5bdfce8e74fc req-98fd13d6-4101-4dfd-b38e-14a129e9814d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:28.297138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-6e42ee55-01e3-48af-8465-5bdfce8e74fc req-98fd13d6-4101-4dfd-b38e-14a129e9814d service nova] Creating event network-changed:63dd5148-73a2-4a63-82b7-9ff29b225fee for instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 on hv-cinder-80660 Aug 31 13:45:28.302419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-6e42ee55-01e3-48af-8465-5bdfce8e74fc req-98fd13d6-4101-4dfd-b38e-14a129e9814d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032404 Aug 31 13:45:28.303540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 458/957] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:28 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:28.352429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-49ab7a8a-d434-4bbf-a615-b3a25cd8cb71 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.084299 Aug 31 13:45:28.353330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 500/958] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:28 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:28.599831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:28.600602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:28.608637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:28.609012 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:28.610387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:28.610387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:28.825549 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:28.834462 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:28.836028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:28.837400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3a3cf821-d5c0-48d2-a363-6d7ee6134138 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.242458 Aug 31 13:45:28.838198 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 459/959] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:28 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:29.365593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:29.366987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:29.375441 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:29.375875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:29.376679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:29.377101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:29.449701 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4a4af078-ba35-4356-8acc-87e5d6a14635 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.088748 Aug 31 13:45:29.450272 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 501/960] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:29 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:29.857550 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:29.858189 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:29.865209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:29.865650 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:29.866463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:29.867101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:30.007881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:30.016816 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:30.018316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:30.019530 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-79d3dd49-da06-470a-8f48-055c103228a8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.166000 Aug 31 13:45:30.020104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 460/961] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:29 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:30.527729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:30.529178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:30.536320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:30.536794 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:30.537584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:30.538015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:30.602574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-cbd8341d-0273-416a-8466-86e6c840db33 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.144649 Aug 31 13:45:30.603217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 502/962] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:30 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:31.043464 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:31.044506 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:31.054488 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:31.055020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:31.056213 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:31.056860 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:31.195917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:31.205765 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:31.207831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:31.209454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8da82e3f-2e2f-400b-ad13-ff4f45fd9b52 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.172361 Aug 31 13:45:31.210007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 461/963] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:31 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:31.615476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:31.616561 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:31.624138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:31.624632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:31.625601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:31.626118 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:31.703933 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-08c1d7b7-5b69-45ed-9db0-c510c65810cb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.092723 Aug 31 13:45:31.704601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 503/964] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:31 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:32.230919 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:32.231520 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:32.240135 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:32.241287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:32.242258 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:32.243905 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:32.391209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:32.399614 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:32.401258 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:32.402408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f7182026-497a-4916-954c-901cd9e2250b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1743 microversion: 2.20 time: 0.175383 Aug 31 13:45:32.402991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 462/965] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:32 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:32.716835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:32.717753 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:32.725906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:32.726375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:32.727166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:32.727642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:32.813851 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9218b3c6-f4b4-4f88-baca-3f4c8b23000c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.101144 Aug 31 13:45:32.814516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 504/966] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:32 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:33.212170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:33.213196 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:33.219994 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.220483 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.221313 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.221784 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.303422 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-25f9d27d-1115-49ec-ba90-260410552c4f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/action" status: 202 len: 0 microversion: 2.1 time: 0.096572 Aug 31 13:45:33.304432 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 463/967] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:33 2021] POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:45:33.314376 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:33.316138 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:33.327509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.328287 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.329400 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.329917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.422687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:33.423433 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:33.430920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.431370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.432130 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.432801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.478658 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:33.488839 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6e1f4fb4-46da-4936-9f77-998a7337a99f tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1751 microversion: 2.1 time: 0.179421 Aug 31 13:45:33.489441 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 505/968] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:33 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1751 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:33.652761 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:33.663826 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:33.665383 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:33.666570 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e5a5c1cd-fbb9-445a-a0d2-1a55cba95bea tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1743 microversion: 2.20 time: 0.248396 Aug 31 13:45:33.667173 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 464/969] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:33 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:33.826686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:33.827783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:33.835505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.835897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.837140 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:33.837622 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:33.917019 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2f692010-097d-4638-9277-8e3ebbf500f4 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.094743 Aug 31 13:45:33.918001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 506/970] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:33 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:34.508005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:34.508734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:34.515744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:34.516133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:34.517026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:34.517531 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:34.679958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:34.686206 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:34.686899 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:34.687971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-84bbccc5-c6c0-4523-af71-c20fc93d6ec6 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.184774 Aug 31 13:45:34.688670 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 465/971] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:34 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:34.695123 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:34.695567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:34.696564 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:34.697294 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:34.851871 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:34.862128 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:34.863952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:34.865388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-71e46fc9-f815-4a69-9ef2-800364c4c74f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.184613 Aug 31 13:45:34.866021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 507/972] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:34 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:34.929761 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:34.930974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:34.937778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:34.938751 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:34.939545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:34.940483 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:35.010637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ecd97fa9-d788-437c-b47d-68ce23f598ac tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.085448 Aug 31 13:45:35.011759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 466/973] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:34 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:35.706668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:35.707694 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:35.715759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:35.716705 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:35.717767 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:35.718205 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:35.880976 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:35.889805 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-eb2be370-2a90-4d31-ac33-d316d8c57c8e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.186985 Aug 31 13:45:35.897642 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 508/974] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:35 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:35.898998 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:35.900355 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:35.910801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:35.911469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:35.912298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:35.912995 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.024717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:36.026153 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:36.036306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.037244 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.038674 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.039293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.085066 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:36.095105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:36.096745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:36.098265 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-42c883f9-8f45-4055-b2ad-1e8c368393db tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.214098 Aug 31 13:45:36.109789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 467/975] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:35 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:36.119704 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2348abfe-be28-4a4b-9dd6-71c02d6d51ea tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.099739 Aug 31 13:45:36.121043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 509/976] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:36 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:45:36.362142 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:36.365856 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:36.372001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.372744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.373935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.376869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.405080 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:45:36.601310 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c4bf1e61-3193-4da6-9409-1ff106a9b58f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 204 len: 0 microversion: 2.1 time: 0.243231 Aug 31 13:45:36.602015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 468/977] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:45:36 2021] DELETE /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:45:36.611634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:36.612705 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:36.620046 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.620907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.621868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.622457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.795726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:36.806918 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-21fff7b6-1e0a-4345-9687-4a1c26da3183 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1577 microversion: 2.1 time: 0.200096 Aug 31 13:45:36.820503 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 510/978] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:36 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1577 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:36.907638 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:36.908810 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:36.915969 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.918517 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.919492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:36.920559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:36.991584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-94d48119-15fd-42bf-a0ce-80bf7df671c8 req-453a6451-b70f-4caf-bb16-a3876968e852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "name": "network-vif-plugged", "status": "completed", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:36.993202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:36.993202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:37.008263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-94d48119-15fd-42bf-a0ce-80bf7df671c8 req-453a6451-b70f-4caf-bb16-a3876968e852 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.008758 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-94d48119-15fd-42bf-a0ce-80bf7df671c8 req-453a6451-b70f-4caf-bb16-a3876968e852 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:37.038113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-94d48119-15fd-42bf-a0ce-80bf7df671c8 req-453a6451-b70f-4caf-bb16-a3876968e852 service nova] Creating event network-vif-plugged:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:45:37.054350 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-94d48119-15fd-42bf-a0ce-80bf7df671c8 req-453a6451-b70f-4caf-bb16-a3876968e852 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.068586 Aug 31 13:45:37.055170 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 511/979] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:37.110328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:37.118963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:37.120075 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:37.122716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3e9897a1-b68a-4e1b-8372-e645d01598ba tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.219268 Aug 31 13:45:37.134709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 469/980] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:36 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:37.134709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:37.140005 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.140509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:37.141301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.141726 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:37.141933 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:37.150398 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.150792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:37.151569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.151993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:37.244612 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a8c7fa31-bd88-4826-b0a7-832073a7a8f8 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.116248 Aug 31 13:45:37.245571 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 470/981] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:37 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:45:37.322827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:37.332583 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:37.334740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:37.335962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9464c738-5187-494c-b8fc-31752e8f0709 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.222626 Aug 31 13:45:37.336800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 512/982] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:37 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:37.828707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:37.829684 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:37.837835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.838716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:37.839984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:37.840756 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.006814 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:38.015764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e03a3f19-5edb-4af8-9200-1edf0184c27e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1577 microversion: 2.1 time: 0.191508 Aug 31 13:45:38.016691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 471/983] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:37 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1577 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:38.141671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:38.142295 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:38.150779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:38.150779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.151393 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:38.152042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.257979 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:38.259153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:38.266760 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:38.267307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.268169 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:38.268712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.324731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:38.334358 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-abad73f2-598c-4df1-906d-16a3b5a427ce tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.196616 Aug 31 13:45:38.335071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 513/984] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:38 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:38.352242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6360cc7c-59b8-4b9a-a0b1-f3b20976c316 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.097802 Aug 31 13:45:38.353281 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 472/985] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:38 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:45:38.357890 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:38.358594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:38.366224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:38.366942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.367755 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:38.368248 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:38.519576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:38.529371 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:38.531089 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:38.532421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-edffe4b3-b424-45ea-9399-316f199c677d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.182335 Aug 31 13:45:38.533411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 514/986] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:38 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:39.041649 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:39.046040 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:39.056861 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.057628 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.058855 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.059759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.315229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:39.326510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f9040fe2-879f-43ac-9926-486da55df6b2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1577 microversion: 2.1 time: 0.295641 Aug 31 13:45:39.327379 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 473/987] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:39 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1577 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:39.352861 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:39.354309 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:39.364041 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:39.366625 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:39.371006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.371355 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.372043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.372530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.385534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.386488 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.389074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.389074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.493392 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-eb4f6848-8e89-461f-9ac6-3443f42c9365 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 14 microversion: 2.1 time: 0.131758 Aug 31 13:45:39.494447 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 474/988] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:39 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 14 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 31 13:45:39.552694 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:39.553415 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:39.569704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.570130 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.572815 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:39.573275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:39.620436 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:39.635836 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b26077c8-c91b-4672-8fb5-0d6c0d038e85 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.287289 Aug 31 13:45:39.637421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 515/989] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:39 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:39.844554 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:39.854735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:39.856662 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:39.858092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-750ec68b-18fd-48e5-8407-35314338d0eb tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.309954 Aug 31 13:45:39.870258 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 475/990] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:39 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:40.095157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-498a2cb3-665c-4ff3-90c6-c46faa17b5d6 req-b8ee87b5-d215-4749-9db2-00b2e99c3a31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81610f93-fb19-4d2b-9ce6-2fb98e042bb8", "name": "network-vif-deleted", "tag": "24a32f0b-1fb5-4a9d-88cd-93dba8debd20"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:40.097576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:40.097576 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:40.129334 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-498a2cb3-665c-4ff3-90c6-c46faa17b5d6 req-b8ee87b5-d215-4749-9db2-00b2e99c3a31 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.129783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-498a2cb3-665c-4ff3-90c6-c46faa17b5d6 req-b8ee87b5-d215-4749-9db2-00b2e99c3a31 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.147592 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-498a2cb3-665c-4ff3-90c6-c46faa17b5d6 req-b8ee87b5-d215-4749-9db2-00b2e99c3a31 service nova] Creating event network-vif-deleted:24a32f0b-1fb5-4a9d-88cd-93dba8debd20 for instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 on hv-cinder-80660 Aug 31 13:45:40.155930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-498a2cb3-665c-4ff3-90c6-c46faa17b5d6 req-b8ee87b5-d215-4749-9db2-00b2e99c3a31 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065402 Aug 31 13:45:40.157333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 516/991] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:45:40.345714 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:40.346599 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:40.361798 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.362342 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.363247 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.363970 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.453618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:40.461855 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8dd4f684-6fe7-442e-9658-9679aa095409 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 200 len: 1225 microversion: 2.1 time: 0.120121 Aug 31 13:45:40.471891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 476/992] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:40 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 1225 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:40.506647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:40.510717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:40.518235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.519057 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.520591 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.521544 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.623771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d16a2459-19a3-4262-813f-40d08cfa8c27 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 9709 microversion: 2.1 time: 0.122520 Aug 31 13:45:40.625350 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 517/993] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:40 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 9709 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:40.660477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:40.660477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:40.672959 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.674222 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.675513 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.676453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.891884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:40.902624 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:40.907940 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:40.911105 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.911546 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.912602 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:40.913195 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:40.920555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-efff2406-c744-49ce-b077-469aa92fb902 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.267133 Aug 31 13:45:40.933555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 477/994] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:40 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:41.156684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:41.175124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:41.177098 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:41.178386 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0984121a-df60-40ce-ba8a-c6b431f517a0 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.302776 Aug 31 13:45:41.193311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 518/995] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:40 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:41.480178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:41.481484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:41.496250 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:41.496743 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:41.497538 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:41.497967 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:41.515065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] HTTP exception thrown: Instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 could not be found. Aug 31 13:45:41.516058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Returning 404 to user: Instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:45:41.517239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a70e9c07-9ea4-4ebd-a86e-2ce03ab2b4bb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 404 len: 111 microversion: 2.1 time: 0.041188 Aug 31 13:45:41.518331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 478/996] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:41 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:45:41.638640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:41.640659 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:41.654127 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-734023937", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1084113261", "security_groups": [{"name": "tempest-secgroup-smoke-2048621792"}], "block_device_mapping_v2": [{"uuid": "17a66ab2-7254-458c-a6fe-f027ad4548f1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eadfe07a-649e-4ecc-ab96-dbd117253913"}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:41.654910 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:41.655413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:41.656330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:41.656875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:41.761683 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9e0445b7-6e3b-40e2-9d16-0793ca130240 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 15612 microversion: 2.1 time: 0.127591 Aug 31 13:45:41.767019 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 519/997] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:41 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 15612 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:41.830259 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] validate_networks() for [('eadfe07a-649e-4ecc-ab96-dbd117253913', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:45:41.940932 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:41.942032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:41.961756 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:41.962213 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:41.963776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:41.963776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.139603 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:42.150354 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-41cc759e-b650-4889-acbb-26b8107609d8 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.213975 Aug 31 13:45:42.151352 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 520/998] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:41 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:42.210254 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:42.210933 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:42.218853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:42.219779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.221055 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:42.221926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.398578 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:45:42.399301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:45:42.400276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:45:42.401083 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:45:42.401833 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:45:42.412384 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:42.412835 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.413634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:42.414063 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.431724 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:42.434999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:45:42.441048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for user 83dc5c95f312476599549f1901dbe9ff and project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:45:42.445511 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:42.447477 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:42.449288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b9237de8-d95c-4b51-9ffa-0b8ce2dae24f tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.247135 Aug 31 13:45:42.450111 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 521/999] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:42 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:42.518630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:45:42.521947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='17a66ab2-7254-458c-a6fe-f027ad4548f1',volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:45:42.698418 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-17430358-4dd7-46f3-80c9-9006d7a8ec99 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.047703 Aug 31 13:45:42.700026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 479/1000] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:45:41 2021] POST /compute/v2.1/servers => generated 406 bytes in 1051 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 31 13:45:42.711647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-64bb15d5-5d08-4c65-9c29-5375e29956c8 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:42.714062 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-64bb15d5-5d08-4c65-9c29-5375e29956c8 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:42.776991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:42.778663 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:42.786869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:42.787639 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.788702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:42.790039 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:42.803595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-64bb15d5-5d08-4c65-9c29-5375e29956c8 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:42.811961 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-64bb15d5-5d08-4c65-9c29-5375e29956c8 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1094 microversion: 2.1 time: 0.104369 Aug 31 13:45:42.815203 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 522/1001] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:42 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1094 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:42.889343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b440c7dd-644c-4ee3-94c4-9cfdf2c65cb6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 18608 microversion: 2.1 time: 0.114986 Aug 31 13:45:42.897808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 480/1002] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:42 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 18608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:45:43.168712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:43.169433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:43.179103 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.179560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.180349 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.180823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.335189 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:43.344473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-72694e8b-41ba-4c3f-b138-fee1c7958093 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.179742 Aug 31 13:45:43.345471 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 523/1003] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:43 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:43.469176 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:43.469911 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:43.478046 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.478841 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.480991 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.482005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.652146 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:43.667497 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:43.669079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:43.670710 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-06ddd397-d731-4057-aae9-0d0221d52d51 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.206239 Aug 31 13:45:43.671858 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 481/1004] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:43 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:43.843292 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:43.844707 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:43.853736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.854660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.855643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.856403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.914931 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:43.929143 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:43.939830 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.942661 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.944216 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:43.944857 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:43.965829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:43.986715 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-38f1044c-00dc-4132-b751-ffb168335543 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1192 microversion: 2.1 time: 0.147177 Aug 31 13:45:43.987968 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 524/1005] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:43 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1192 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:44.061099 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b1293522-6fd2-45d6-a29e-8ca30782fa6b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 20018 microversion: 2.1 time: 0.160259 Aug 31 13:45:44.061780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 482/1006] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:43 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 20018 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:44.364649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:44.365947 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:44.375087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:44.375827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:44.376960 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:44.378272 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:44.589516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:44.598452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5abd34a2-dfa0-41de-8c74-de6a7337431a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.237581 Aug 31 13:45:44.599330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 525/1007] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:44 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:44.696999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:44.699341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:44.723329 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:44.724286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:44.725714 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:44.728692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.005561 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:45.006907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:45.014618 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:45.019595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.020998 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:45.021729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.101614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:45.114172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1a8d6e18-f7ed-483b-bf88-75135b163bfc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1210 microversion: 2.1 time: 0.113029 Aug 31 13:45:45.123140 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:45.126915 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 526/1008] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:44 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1210 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:45:45.132901 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:45.133353 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:45.135292 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:45.135806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ee33bad2-8376-48f7-8cea-d34e4d2952bd tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1738 microversion: 2.20 time: 0.447459 Aug 31 13:45:45.136329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:45.136490 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 483/1009] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:44 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1738 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:45.147011 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:45.148270 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.149427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:45.150181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.262906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-be5e23e0-7b5c-4c35-8830-190d6716c9c1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 22716 microversion: 2.1 time: 0.133263 Aug 31 13:45:45.264314 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 527/1010] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:45 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 22716 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:45.615588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:45.616514 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:45.623204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:45.623733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.624662 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:45.625163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:45.812508 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:45.821574 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a402faa6-22f3-48d9-9071-20bc509f1f3b tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.210129 Aug 31 13:45:45.822189 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 484/1011] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:45 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:46.134345 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:46.135126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:46.142450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.142906 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.143696 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.144181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.163958 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:46.166718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:46.184617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.185287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.186616 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.190996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.357601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:46.381158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-76ce83dd-a4f4-45de-90b8-f56cfa947d71 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.250183 Aug 31 13:45:46.383521 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 528/1012] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:46 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:46.390814 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-9932ff5e-1691-4ae1-8b75-2420ef7c8aa0 req-de2591a9-b8f3-4d5b-9fae-5537f3f6ad32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050856c4-86f9-4f1f-a482-b2503a93a0bf", "tag": "567e463b-a026-495f-bb7e-bbfaff1cc7c1"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:46.393223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:46.393223 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:46.403466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-9932ff5e-1691-4ae1-8b75-2420ef7c8aa0 req-de2591a9-b8f3-4d5b-9fae-5537f3f6ad32 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.404346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-9932ff5e-1691-4ae1-8b75-2420ef7c8aa0 req-de2591a9-b8f3-4d5b-9fae-5537f3f6ad32 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.426354 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-9932ff5e-1691-4ae1-8b75-2420ef7c8aa0 req-de2591a9-b8f3-4d5b-9fae-5537f3f6ad32 service nova] Creating event network-changed:567e463b-a026-495f-bb7e-bbfaff1cc7c1 for instance 050856c4-86f9-4f1f-a482-b2503a93a0bf on hv-cinder-80660 Aug 31 13:45:46.436339 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-9932ff5e-1691-4ae1-8b75-2420ef7c8aa0 req-de2591a9-b8f3-4d5b-9fae-5537f3f6ad32 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050664 Aug 31 13:45:46.437796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 529/1013] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:46 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:46.447985 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:46.450180 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:46.461701 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.462380 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.464202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.465250 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.561322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-243d9adf-4171-42be-a77a-f1c3921e00f6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 23907 microversion: 2.1 time: 0.121150 Aug 31 13:45:46.562601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 530/1014] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:46 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 23907 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:46.734745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:46.744226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:46.746053 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:46.747255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-8ab4d9fc-f74d-43d9-997e-45c15b036f1d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1720 microversion: 2.20 time: 0.590564 Aug 31 13:45:46.748010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 485/1015] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:46 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1720 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:46.841855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:46.842647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:46.850898 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.851501 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:46.852301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:46.852770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.022773 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:47.031990 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8d7e6673-41f6-4a54-b8a4-fe57607d1248 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.195236 Aug 31 13:45:47.032658 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 531/1016] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:46 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:47.409936 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:47.410984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:47.419033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:47.419481 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.420268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:47.420756 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.573623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:47.574547 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:47.581044 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:47.581511 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.582683 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:47.583125 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.650783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:47.660150 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b006629c-ec61-49d2-87ed-90bd2834da9a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 25445 microversion: 2.1 time: 0.090405 Aug 31 13:45:47.661154 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3ee8db68-cf47-4a6b-b081-3efa54850911 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.255279 Aug 31 13:45:47.661329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 532/1017] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:47 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 25445 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:47.662712 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 486/1018] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:47 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:47.767715 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:47.768417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:47.775764 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:47.776215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.777032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:47.777459 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:47.912027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:47.920984 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:47.922538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:47.923719 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a32b2949-3ec2-42c8-b0ee-e825fd523b0c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1720 microversion: 2.20 time: 0.160359 Aug 31 13:45:47.924290 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 533/1019] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:47 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1720 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:48.050230 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:48.050881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:48.058257 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.058735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.059547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.059977 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.197396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:48.206671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9d57644d-ff77-493e-b70d-fe495aa42de3 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.160241 Aug 31 13:45:48.207382 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 487/1020] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:48 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:48.672709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:48.674434 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:48.679977 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:48.680657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:48.682063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.682480 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.683629 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.684181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.687387 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.687828 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.688680 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.689117 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.777368 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-497e19dc-7025-42e3-9f3d-98b4fc89d976 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 26695 microversion: 2.1 time: 0.108078 Aug 31 13:45:48.778030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 534/1021] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:48 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 26695 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:48.835624 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:48.844784 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-777f051a-8f52-4bd1-baf9-abc7ba19c8f7 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.169424 Aug 31 13:45:48.845414 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 488/1022] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:48 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:45:48.943884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:48.944509 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:48.952409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.952872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:48.953663 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:48.954093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.105058 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:49.114577 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:49.116454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:49.117684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-38230004-40b2-49a9-bfe6-3255c17b6cc5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1723 microversion: 2.20 time: 0.178512 Aug 31 13:45:49.118322 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 535/1023] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:48 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1723 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:49.138720 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3fc0ce4-8b1f-4694-adb9-12d5b9982435"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:49.140540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:49.147637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.148672 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.149651 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.150092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.224132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:49.224800 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:49.231235 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.231674 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.232492 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.232923 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.379702 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:49.388475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0f8fe445-f052-487f-a6cb-dbf50270531a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1756 microversion: 2.1 time: 0.168279 Aug 31 13:45:49.389068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 536/1024] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:49 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1756 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:49.444684 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fb12277c-1299-44fe-a6a6-f0e0e54bc601 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.309680 Aug 31 13:45:49.445769 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 489/1025] 10.222.0.21 () {62 vars in 1364 bytes} [Tue Aug 31 13:45:49 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-volume_attachments => generated 188 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:45:49.574950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:49.575452 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:49.582436 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.582926 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.583718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.584215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.791184 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:49.792422 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:49.799144 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.799587 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.800572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.801071 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.887028 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-96480d9a-3a2c-43b9-a032-943e7bf11058 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-volume_attachments/a3fc0ce4-8b1f-4694-adb9-12d5b9982435" status: 202 len: 0 microversion: 2.20 time: 0.315808 Aug 31 13:45:49.888517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 537/1026] 10.222.0.21 () {60 vars in 1457 bytes} [Tue Aug 31 13:45:49 2021] DELETE /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-volume_attachments/a3fc0ce4-8b1f-4694-adb9-12d5b9982435 => generated 0 bytes in 318 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:45:49.888749 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-00389f5d-fa3a-489e-ab1d-62a97a594a2a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 27528 microversion: 2.1 time: 0.101575 Aug 31 13:45:49.889838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 490/1027] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:49 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 27528 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:45:49.900594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:49.901195 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:49.910216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.910685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.911515 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.911937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.964504 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:49.965374 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:49.973225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.973665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:49.974691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:49.974865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.065574 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-69475242-1efe-420d-b5ce-c1cd30abcb86 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action" status: 202 len: 0 microversion: 2.20 time: 0.106566 Aug 31 13:45:50.066340 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 491/1028] 10.222.0.21 () {62 vars in 1319 bytes} [Tue Aug 31 13:45:49 2021] POST /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Aug 31 13:45:50.068152 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:50.074782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:50.075443 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:50.080421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-78a405d7-3708-41e8-a4fc-feea56672768 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.183591 Aug 31 13:45:50.081923 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 538/1029] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:49 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:50.082691 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.083216 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.084019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.084494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.234022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:50.243247 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:50.244951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:50.246237 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b1cc902c-a2c7-4f7f-8190-7c2bb1c2a7d5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1671 microversion: 2.20 time: 0.175461 Aug 31 13:45:50.246898 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 492/1030] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:50 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1671 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:50.405657 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:50.406256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:50.417821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.418361 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.419172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.419626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.573875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:50.582738 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a812c3c5-6e95-462f-8c9f-25fad615b39a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1759 microversion: 2.1 time: 0.180763 Aug 31 13:45:50.583307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 539/1031] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:50 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1759 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:50.901750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:50.902742 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:50.913187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.913187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.913501 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.913872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.917348 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-b23d11d0-c9cb-4993-86f0-054027d1c159 req-a59b56a9-b97f-4d4b-95da-f8d6d4a6bee7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "name": "network-vif-unplugged", "status": "completed", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:50.919126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:45:50.919126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:45:50.927703 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-b23d11d0-c9cb-4993-86f0-054027d1c159 req-a59b56a9-b97f-4d4b-95da-f8d6d4a6bee7 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:50.928179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-b23d11d0-c9cb-4993-86f0-054027d1c159 req-a59b56a9-b97f-4d4b-95da-f8d6d4a6bee7 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:50.946380 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-b23d11d0-c9cb-4993-86f0-054027d1c159 req-a59b56a9-b97f-4d4b-95da-f8d6d4a6bee7 service nova] Creating event network-vif-unplugged:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:45:50.951589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-b23d11d0-c9cb-4993-86f0-054027d1c159 req-a59b56a9-b97f-4d4b-95da-f8d6d4a6bee7 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.038197 Aug 31 13:45:50.952491 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 540/1032] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:45:50 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:45:51.008945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e48296d1-b457-4f34-a545-d02f358198fc tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 27984 microversion: 2.1 time: 0.110801 Aug 31 13:45:51.009972 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 493/1033] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:50 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 27984 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:45:51.099982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:51.100692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:51.107333 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:51.107808 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:51.108625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:51.109242 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:51.242069 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:51.249584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-aae0b01e-a57b-40d8-8152-731214623200 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.154348 Aug 31 13:45:51.250173 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 541/1034] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:51 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:51.265594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:51.266289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:51.273227 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:51.273677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:51.274439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:51.274867 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:51.470428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:51.479079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:51.480716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:51.481924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-db095925-40ed-4c7f-9f4e-38a77e48f9ff tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.220568 Aug 31 13:45:51.482503 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 494/1035] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:51 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:52.020922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:45:52.022036 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:52.029048 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:52.029478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:52.030460 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:52.030894 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:52.270613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:52.271956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:52.278534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:52.278964 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:52.279733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:52.280207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:52.430370 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:52.439207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fc581ed2-c532-478b-8314-01967d87639f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.172718 Aug 31 13:45:52.440577 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 495/1036] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:52 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:52.501643 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:52.502557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:52.509772 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:52.510209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:52.510975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:52.511395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:52.651823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:52.663693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:52.665437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:52.666847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c1b50b8a-0ca5-49ac-8d3c-90c46aa9f3f1 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.169604 Aug 31 13:45:52.667671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 496/1037] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:52 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:53.456629 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:53.457326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:53.463693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:53.464133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:53.464929 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:53.465352 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:53.607002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:53.614717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a762e259-c9be-44a7-89db-a317163cc0ce tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.161762 Aug 31 13:45:53.615289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 497/1038] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:53 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:53.684759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:53.685357 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:53.691646 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:53.692084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:53.692884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:53.693304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:53.829044 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:53.837963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:53.839437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:53.840824 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ef09ed75-d9c3-44b1-80c8-126fbeb1aa56 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.159840 Aug 31 13:45:53.841374 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 498/1039] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:53 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:54.633536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:54.633536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:54.642294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:54.642731 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:54.643472 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:54.644122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:54.792728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:54.801448 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b1682e23-1f1f-40eb-b61b-caac943afd40 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.172294 Aug 31 13:45:54.802040 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 499/1040] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:54 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:54.860069 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:54.860973 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:54.868303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:54.868734 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:54.869499 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:54.869951 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:55.023763 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:55.034195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:55.035719 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:55.037140 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-997cfb12-4706-4d15-b754-a428a475357c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.181323 Aug 31 13:45:55.037724 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 500/1041] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:54 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:55.820414 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:55.821271 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:55.827947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:55.828409 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:55.829200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:55.829634 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:55.962649 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:55.970585 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d84eaa6b-63f1-40b6-a90f-3e582eab94bc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.154769 Aug 31 13:45:55.971472 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 501/1042] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:55 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:56.055884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:56.056565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:56.062924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:56.063377 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:56.064163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:56.064722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:56.206341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:56.215170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:56.217183 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:56.218413 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f98769f6-3fa1-4422-8bf7-58d9c58ced5e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.166361 Aug 31 13:45:56.219205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 502/1043] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:56 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:45:56.988203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:56.988966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:56.996447 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:56.996954 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:56.997733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:56.998161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:57.130778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:57.139064 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-bf998b4b-308e-496f-ad72-52551b7f14c4 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.154855 Aug 31 13:45:57.139663 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 503/1044] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:56 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:57.238168 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:57.238695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:57.245438 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:57.245896 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:57.246740 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:57.247191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:57.396984 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:57.408569 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:57.410637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:57.411926 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5229e158-f22b-4252-81ce-b74d65f72ce9 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.178459 Aug 31 13:45:57.412491 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 504/1045] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:57 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:58.159846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:58.160561 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:58.167195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:58.167493 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:58.168282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:58.168766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:58.299468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:58.308190 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-104c7fe0-8019-4590-bca4-fdeed947bbdb tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.154118 Aug 31 13:45:58.308820 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 505/1046] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:58 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:45:58.436115 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:58.436595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:58.443645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:58.444094 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:58.444941 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:58.445379 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:58.609077 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:58.620244 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:58.621779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:58.622948 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-821882ca-aa56-4c20-bddb-910b074db15d tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.192734 Aug 31 13:45:58.623509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 506/1047] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:58 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:45:59.338754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:59.339595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:59.348516 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:59.348979 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:59.350028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:59.350906 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:59.487454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:59.496430 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-565d6ac4-59d4-4207-81f5-9a0027afd92d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.163203 Aug 31 13:45:59.500425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 507/1048] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:45:59 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:45:59.648459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:45:59.649627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:45:59.660001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:59.660754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:59.662040 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:45:59.662759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:45:59.798768 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:59.806957 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:59.808486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:45:59.809637 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3aefcf39-49e6-4882-8134-286b18f4ef5a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.170092 Aug 31 13:45:59.810171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 508/1049] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:45:59 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:46:00.515116 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:00.515830 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:00.522342 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:00.522786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:00.523559 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:00.523989 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:00.688529 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:00.704270 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7a6aa4fd-9c83-4018-9dd8-369c64985236 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.193015 Aug 31 13:46:00.705395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 509/1050] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:00 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:00.828744 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:00.829436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:00.835987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:00.836449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:00.837373 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:00.838058 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:00.983778 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:00.992439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:00.994108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:00.995705 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5af7821b-aab1-4f50-a735-cb1e481ec87a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.171146 Aug 31 13:46:00.996301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 510/1051] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:00 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:46:01.729573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:01.730575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:01.737346 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:01.737836 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:01.738630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:01.739130 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:01.902966 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:01.915005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-85a4c877-2a36-4e93-813c-6509013cd6aa tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.190812 Aug 31 13:46:01.924935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 511/1052] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:01 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:46:02.014750 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:02.015267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:02.021638 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:02.022100 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:02.022902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:02.023332 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:02.163594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:02.172040 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:02.173557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:02.174723 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b33c43a2-b9d7-47c4-8bb1-78083f80a9a5 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.164030 Aug 31 13:46:02.175292 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 512/1053] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:02 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:02.931992 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:02.932877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:02.939864 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:02.944707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:02.944707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:02.944707 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:03.075677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:03.083704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2d091a65-0fbd-4c13-95ba-564e9f37516a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.155496 Aug 31 13:46:03.084254 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 513/1054] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:02 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:46:03.193478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:03.193997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:03.200999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:03.201436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:03.202197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:03.202616 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:03.340617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:03.349424 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:03.350908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:03.352046 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b2468d2f-413e-4128-9b36-bedf09b3484e tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.162444 Aug 31 13:46:03.352645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 514/1055] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:03 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:03.544180 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ce605c49-1575-49dc-abf1-d4fc7f8a24ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 34407 microversion: 2.1 time: 11.526669 Aug 31 13:46:03.544866 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 542/1056] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:45:52 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 34407 bytes in 11529 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:46:04.109116 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:04.109739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:04.118908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:04.119573 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:04.120260 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:04.120960 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:04.264410 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:04.276009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2175a89f-502d-49a3-a17a-7159f8258cef tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.172877 Aug 31 13:46:04.276785 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 515/1057] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:04 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:04.374275 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:04.375183 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:04.384710 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:04.385382 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:04.386380 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:04.386941 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:04.535475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:04.546706 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:04.548187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:04.549362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-2f51ae72-8737-4e6e-a077-2e85d9c68c83 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.181247 Aug 31 13:46:04.549942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 543/1058] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:04 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:04.556745 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:04.557755 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:04.564417 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:04.564860 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:04.565623 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:04.566048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:04.645856 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-74dd2249-dd54-46b2-9c23-bff75cdaed74 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 35266 microversion: 2.1 time: 0.092670 Aug 31 13:46:04.646533 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 516/1059] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:04 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 35266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:46:05.293989 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:05.294621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:05.301988 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:05.301988 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:05.302259 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:05.302514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:05.443828 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:05.451309 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a9d52a30-efc2-40dc-bbe0-cf16d80ec4bf tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.161465 Aug 31 13:46:05.451887 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 544/1060] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:05 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:05.569708 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:05.570276 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:05.577469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:05.577975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:05.578662 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:05.579090 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:05.658671 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:05.659614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:05.665665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:05.666106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:05.666878 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:05.667306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:05.722797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:05.736674 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:05.738155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:05.739301 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ff909923-68f2-4b9b-a67c-fcb89fc2e27c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.174222 Aug 31 13:46:05.739869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 517/1061] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:05 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:05.747159 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c7557b55-654b-4d0d-9d90-3231c39243e6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 36433 microversion: 2.1 time: 0.092307 Aug 31 13:46:05.750809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 545/1062] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:05 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 36433 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:46:06.475598 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:06.476172 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:06.483272 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:06.483802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:06.485110 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:06.485556 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:06.642482 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:06.650031 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-65261d70-1260-4225-9110-0f902c698053 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.179161 Aug 31 13:46:06.650588 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 518/1063] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:06 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:06.759615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:06.760027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:06.760564 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:06.760736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:06.767900 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:06.768200 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:06.768403 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:06.768678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:06.769133 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:06.769445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:06.769698 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:06.769853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:06.843860 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4c257c7b-38f3-46bc-83dd-f02920a1f233 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 37740 microversion: 2.1 time: 0.087507 Aug 31 13:46:06.844702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 519/1064] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:06 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 37740 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:46:06.911675 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:06.919749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:06.921279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:06.922884 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-dfbbea53-e303-4180-bb5c-0390bcfc046a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.166998 Aug 31 13:46:06.923435 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 546/1065] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:06 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:07.667856 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:07.668583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:07.676849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:07.677294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:07.678073 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:07.678503 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:07.805618 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:07.813909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7163edda-51ed-4fce-a226-388ae838a732 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.150220 Aug 31 13:46:07.814519 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 520/1066] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:07 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:07.856074 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:07.857708 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:07.864242 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:07.864725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:07.865525 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:07.865954 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:07.941544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:07.942155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:07.948229 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:07.948717 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:07.949482 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:07.949911 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:08.017904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e764f204-ff49-40a0-a507-b442df694bd6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 38166 microversion: 2.1 time: 0.165413 Aug 31 13:46:08.018942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 547/1067] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:07 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 38166 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:46:08.081786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:08.095207 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:08.097602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:08.099346 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ed39ff48-ea93-4d6f-ade5-e98db202784c tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.161710 Aug 31 13:46:08.100115 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 521/1068] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:07 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:46:08.832672 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:08.833376 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:08.840718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:08.841268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:08.842049 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:08.842476 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:08.977677 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:08.985454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-840c36a8-63e3-48df-b067-81ec56f100fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.156894 Aug 31 13:46:08.986291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 548/1069] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:08 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:09.029552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:09.030500 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:09.037593 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:09.038018 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:09.038796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:09.039231 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:09.081886 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-a700964e-8c91-4e09-882b-6fe262d1b311 req-16da375c-3e11-4bcb-bf8a-7e0393126841 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "name": "network-vif-plugged", "status": "completed", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:09.083716 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:09.083716 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:46:09.091334 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-a700964e-8c91-4e09-882b-6fe262d1b311 req-16da375c-3e11-4bcb-bf8a-7e0393126841 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:09.091772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-a700964e-8c91-4e09-882b-6fe262d1b311 req-16da375c-3e11-4bcb-bf8a-7e0393126841 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:09.103052 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0dba883f-c51f-4146-add9-c8aa62f853da tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 38166 microversion: 2.1 time: 0.076784 Aug 31 13:46:09.103386 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-a700964e-8c91-4e09-882b-6fe262d1b311 req-16da375c-3e11-4bcb-bf8a-7e0393126841 service nova] Creating event network-vif-plugged:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:46:09.104163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 522/1070] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:09 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 38166 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:46:09.109835 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-a700964e-8c91-4e09-882b-6fe262d1b311 req-16da375c-3e11-4bcb-bf8a-7e0393126841 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032223 Aug 31 13:46:09.110673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 549/1071] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:46:09.118902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:09.119552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:09.126304 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:09.127437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:09.128325 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:09.128779 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:09.271290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:09.279609 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:09.281399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:09.282672 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b0eb8685-ed95-4de9-937e-05c6ffa4a871 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.168600 Aug 31 13:46:09.293624 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 523/1072] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:09 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 31 13:46:10.004114 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:10.004792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:10.011379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:10.011816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:10.012622 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:10.013045 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:10.115127 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:10.116045 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:10.122615 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:10.123091 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:10.123859 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:10.124288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:10.152755 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:10.160743 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c45801d0-2f3a-4023-bd19-da08a55d2f78 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.161757 Aug 31 13:46:10.161343 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 550/1073] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:09 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:10.190838 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c0bea593-18e3-4539-84fe-49f7690c75ed tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 38166 microversion: 2.1 time: 0.079176 Aug 31 13:46:10.191535 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 524/1074] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:10 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 38166 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 31 13:46:10.304317 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:10.305063 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:10.314215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:10.314855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:10.315911 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:10.316406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:10.456084 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:10.465197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:10.466717 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:10.467892 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d6ca1902-a3c5-4ac8-b948-6950268de53b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1729 microversion: 2.20 time: 0.169809 Aug 31 13:46:10.468813 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 551/1075] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:10 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1729 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:11.147312 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-54a09c4f-124c-478d-b8e3-39a516f02993 req-85576cae-7991-41fb-9789-6489f3c9e407 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050856c4-86f9-4f1f-a482-b2503a93a0bf", "name": "network-vif-plugged", "status": "completed", "tag": "567e463b-a026-495f-bb7e-bbfaff1cc7c1"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:11.148908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:11.148908 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:46:11.157322 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-54a09c4f-124c-478d-b8e3-39a516f02993 req-85576cae-7991-41fb-9789-6489f3c9e407 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.157792 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-54a09c4f-124c-478d-b8e3-39a516f02993 req-85576cae-7991-41fb-9789-6489f3c9e407 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.169377 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-54a09c4f-124c-478d-b8e3-39a516f02993 req-85576cae-7991-41fb-9789-6489f3c9e407 service nova] Creating event network-vif-plugged:567e463b-a026-495f-bb7e-bbfaff1cc7c1 for instance 050856c4-86f9-4f1f-a482-b2503a93a0bf on hv-cinder-80660 Aug 31 13:46:11.175104 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-54a09c4f-124c-478d-b8e3-39a516f02993 req-85576cae-7991-41fb-9789-6489f3c9e407 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031856 Aug 31 13:46:11.175754 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 525/1076] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:11 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:11.177269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:11.178575 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:11.184927 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.185467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.186256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.186712 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.203660 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:11.204735 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:11.211474 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.211851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.213000 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.213436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.317657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-83ddf91d-77af-44d6-8b3b-61f85e303874 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action" status: 200 len: 38297 microversion: 2.1 time: 0.118099 Aug 31 13:46:11.318978 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 526/1077] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:11 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/action => generated 38297 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 31 13:46:11.324337 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:11.330981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:11.331583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:11.332521 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9c6239c6-b012-4b16-ba6c-01d22613a52f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.159240 Aug 31 13:46:11.333346 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 552/1078] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:11 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:11.338002 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.338449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.339224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.339648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.367420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e9cefd18-c9ad-4274-af39-c01530cb7a43 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/ips" status: 200 len: 147 microversion: 2.1 time: 0.041537 Aug 31 13:46:11.368024 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 527/1079] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 31 13:46:11 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/ips => generated 147 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:11.491403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:11.492085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:11.499243 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.499875 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.500821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:11.501330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:11.647973 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:11.657332 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:11.658388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:11.659559 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5eeb7bb1-dc43-404d-961a-7921f5b73619 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1716 microversion: 2.20 time: 0.172343 Aug 31 13:46:11.660245 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 553/1080] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:11 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1716 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:12.351010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:12.351619 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:12.358511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:12.358959 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:12.359730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:12.360164 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:12.510258 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:12.520980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-412e2556-0c11-4f8d-b699-4b58a10679a1 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1266 microversion: 2.1 time: 0.173959 Aug 31 13:46:12.521601 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 528/1081] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:12 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:12.722216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "149adc8b-8826-4acd-92a6-42ac43321868"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:12.723530 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:12.730311 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:12.730957 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:12.731667 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:12.732090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:13.003673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8a5ee578-8f3b-4f23-87dc-2c649c93468b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285209 Aug 31 13:46:13.004412 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 554/1082] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:46:12 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments => generated 194 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:13.538107 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:13.538716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:13.545787 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:13.546236 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:13.547006 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:13.547437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:13.689225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:13.697434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-deeda46a-e093-4f64-9a4b-0c9af078381d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1452 microversion: 2.1 time: 0.163169 Aug 31 13:46:13.698033 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 529/1083] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:13 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1452 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:13.714936 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:13.715625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:13.722897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:13.723483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:13.724192 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:13.724758 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:13.860565 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:13.871821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-09d28989-4530-4400-846c-dbaab6af157d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1452 microversion: 2.1 time: 0.161504 Aug 31 13:46:13.872427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 555/1084] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:13 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:15.872834 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-c5bd312d-6cd9-43c6-9846-9df639ad7a0d req-6589e27c-096a-4f96-b55c-e7860c31aaae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050856c4-86f9-4f1f-a482-b2503a93a0bf", "tag": "567e463b-a026-495f-bb7e-bbfaff1cc7c1"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:15.874366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:15.874366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:46:15.882841 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-c5bd312d-6cd9-43c6-9846-9df639ad7a0d req-6589e27c-096a-4f96-b55c-e7860c31aaae service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:15.883062 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-c5bd312d-6cd9-43c6-9846-9df639ad7a0d req-6589e27c-096a-4f96-b55c-e7860c31aaae service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:15.894938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-c5bd312d-6cd9-43c6-9846-9df639ad7a0d req-6589e27c-096a-4f96-b55c-e7860c31aaae service nova] Creating event network-changed:567e463b-a026-495f-bb7e-bbfaff1cc7c1 for instance 050856c4-86f9-4f1f-a482-b2503a93a0bf on hv-cinder-80660 Aug 31 13:46:15.900419 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-c5bd312d-6cd9-43c6-9846-9df639ad7a0d req-6589e27c-096a-4f96-b55c-e7860c31aaae service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031154 Aug 31 13:46:15.901096 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 530/1085] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:20.587071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:20.588458 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:20.597817 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:20.598455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:20.599680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:20.600590 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:20.632929 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-dacfd008-0db5-4273-8363-56baadeea34c tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052084 Aug 31 13:46:20.633479 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 556/1086] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:20 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:20.647777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:20.648446 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:20.656320 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:20.656804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:20.657664 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:20.658099 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:20.688711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f67b6520-075d-4e07-a291-16a501c52bda tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/149adc8b-8826-4acd-92a6-42ac43321868" status: 200 len: 194 microversion: 2.1 time: 0.048349 Aug 31 13:46:20.689315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 531/1087] 10.222.0.21 () {58 vars in 1413 bytes} [Tue Aug 31 13:46:20 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/149adc8b-8826-4acd-92a6-42ac43321868 => generated 194 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:46:22.040850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ded4d051-d755-4fdb-8e20-18992b22306b"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:22.042086 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:22.048533 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:22.048974 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:22.049747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:22.050176 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:22.345762 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-17e9f1e4-ed12-438a-ac8e-33693d77dc65 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.308893 Aug 31 13:46:22.346468 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 557/1088] 10.222.0.21 () {60 vars in 1323 bytes} [Tue Aug 31 13:46:22 2021] POST /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:29.647328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1111256055"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:29.647903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:29.654711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:29.655399 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:29.656204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:29.656668 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:29.794032 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.network.security_group_api [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Removing security group 232c62aa-9a66-4647-812e-4b51d79a469e from port 34eff954-6b81-42e0-814c-eed66d639575 Aug 31 13:46:29.946493 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:29.947534 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:29.954023 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:29.954511 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:29.955286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:29.955684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:29.989415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-258782ea-ba31-4cc0-97d7-ccd56714f73e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047500 Aug 31 13:46:29.989961 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 558/1089] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:29 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:46:30.165385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c2d1d0ce-1835-4879-9357-24b764680be9 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/action" status: 202 len: 0 microversion: 2.1 time: 0.517887 Aug 31 13:46:30.165385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 532/1090] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:46:29 2021] POST /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/action => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:30.170683 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-eea50bc3-60e6-41fc-9218-4d4c28e96a3c req-cd6c21a0-e326-402f-b2cc-aaab53e8110d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:30.172315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:30.172315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:46:30.187608 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-eea50bc3-60e6-41fc-9218-4d4c28e96a3c req-cd6c21a0-e326-402f-b2cc-aaab53e8110d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:30.188043 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-eea50bc3-60e6-41fc-9218-4d4c28e96a3c req-cd6c21a0-e326-402f-b2cc-aaab53e8110d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:30.217301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-eea50bc3-60e6-41fc-9218-4d4c28e96a3c req-cd6c21a0-e326-402f-b2cc-aaab53e8110d service nova] Creating event network-changed:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:46:30.225532 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-eea50bc3-60e6-41fc-9218-4d4c28e96a3c req-cd6c21a0-e326-402f-b2cc-aaab53e8110d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058917 Aug 31 13:46:30.226669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 559/1091] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:30.267527 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:30.268131 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:30.278366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:30.278366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:30.287875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:30.288463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:30.343672 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a46995b2-8920-403e-901b-96c6edff4c7a tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/149adc8b-8826-4acd-92a6-42ac43321868" status: 200 len: 194 microversion: 2.1 time: 0.080462 Aug 31 13:46:30.344770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 533/1092] 10.222.0.21 () {58 vars in 1413 bytes} [Tue Aug 31 13:46:30 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/149adc8b-8826-4acd-92a6-42ac43321868 => generated 194 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:30.359224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:30.360919 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:30.370604 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:30.371073 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:30.371944 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:30.372413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:30.534982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.objects.instance [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lazy-loading 'services' on Instance uuid fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 {{(pid=120181) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:46:30.613181 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-49319f30-77fd-4792-8217-03f3225751f5 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/149adc8b-8826-4acd-92a6-42ac43321868" status: 202 len: 0 microversion: 2.1 time: 0.259362 Aug 31 13:46:30.613904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 560/1093] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:46:30 2021] DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/149adc8b-8826-4acd-92a6-42ac43321868 => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:31.390226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:31.390796 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:31.393121 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-09c97e5e-7f55-4993-88d5-a9997cb192f7 req-dfbb6f3b-f7c5-4a5c-ab73-1da6150a3637 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:31.394948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:31.394948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:46:31.397509 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:31.397996 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:31.398753 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:31.399191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:31.402563 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-09c97e5e-7f55-4993-88d5-a9997cb192f7 req-dfbb6f3b-f7c5-4a5c-ab73-1da6150a3637 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:31.404518 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-09c97e5e-7f55-4993-88d5-a9997cb192f7 req-dfbb6f3b-f7c5-4a5c-ab73-1da6150a3637 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:31.416779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-09c97e5e-7f55-4993-88d5-a9997cb192f7 req-dfbb6f3b-f7c5-4a5c-ab73-1da6150a3637 service nova] Creating event network-changed:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:46:31.422971 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-09c97e5e-7f55-4993-88d5-a9997cb192f7 req-dfbb6f3b-f7c5-4a5c-ab73-1da6150a3637 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034063 Aug 31 13:46:31.423592 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 561/1094] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:31 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:31.494452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lazy-loading 'services' on Instance uuid 12a13a96-7d73-4f6d-b0a8-266b6ee65761 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:46:31.569867 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ae007b4d-ce38-4ed7-b54f-e648d3fe9502 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "DELETE /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments/0ae29258-01f6-4ed9-9c55-24051a7b79b5" status: 202 len: 0 microversion: 2.1 time: 0.183775 Aug 31 13:46:31.580193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:31.581584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:31.584645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 534/1095] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:46:31 2021] DELETE /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments/0ae29258-01f6-4ed9-9c55-24051a7b79b5 => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:31.588679 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:31.589132 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:31.590166 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:31.590861 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:31.631850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7744f935-9c2c-4bfa-88c5-bfff5ad92291 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055957 Aug 31 13:46:31.632462 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 562/1096] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:31 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:32.648021 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:32.649158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:32.656226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:32.656800 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:32.657474 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:32.657893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:32.693376 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-33814b25-8ecd-4717-b27d-8498c4fd0961 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049935 Aug 31 13:46:32.694009 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 535/1097] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:32 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:32.814863 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:32.815420 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:32.822293 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:32.822746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:32.823848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:32.824284 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:32.856518 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e32d3f7c-0116-420b-9fa2-699c8fd1b7d9 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/ded4d051-d755-4fdb-8e20-18992b22306b" status: 200 len: 194 microversion: 2.1 time: 0.046253 Aug 31 13:46:32.857124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 563/1098] 10.222.0.21 () {58 vars in 1413 bytes} [Tue Aug 31 13:46:32 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/ded4d051-d755-4fdb-8e20-18992b22306b => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:32.869396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:32.869883 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:32.876881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:32.877326 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:32.878110 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:32.878582 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:32.974338 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lazy-loading 'services' on Instance uuid fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:46:33.052298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-fd6da960-4e78-44bb-827c-add9b8e47c4d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/ded4d051-d755-4fdb-8e20-18992b22306b" status: 202 len: 0 microversion: 2.1 time: 0.186604 Aug 31 13:46:33.052955 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 536/1099] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:46:32 2021] DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments/ded4d051-d755-4fdb-8e20-18992b22306b => generated 0 bytes in 188 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:33.707327 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:33.708711 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:33.718660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:33.719373 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:33.720586 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:33.721249 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:33.755640 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f7efeee7-b5e2-499b-be59-9eb2627c2e2a tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052151 Aug 31 13:46:33.756231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 564/1100] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:33 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:46:33.768671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:33.769315 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:33.775900 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:33.776352 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:33.777186 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:33.778195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:33.873163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] HTTP exception thrown: Instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 is not attached to volume 0ae29258-01f6-4ed9-9c55-24051a7b79b5 Aug 31 13:46:33.873789 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Returning 404 to user: Instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 is not attached to volume 0ae29258-01f6-4ed9-9c55-24051a7b79b5 {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:33.874777 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5815c6ba-2080-4d25-875a-961b14e28862 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "DELETE /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments/0ae29258-01f6-4ed9-9c55-24051a7b79b5" status: 404 len: 154 microversion: 2.1 time: 0.110828 Aug 31 13:46:33.875558 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 537/1101] 10.222.0.21 () {58 vars in 1416 bytes} [Tue Aug 31 13:46:33 2021] DELETE /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761/os-volume_attachments/0ae29258-01f6-4ed9-9c55-24051a7b79b5 => generated 154 bytes in 112 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:34.239819 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:34.240787 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:34.246974 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.247417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.248178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.248635 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.279823 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f9d8910e-e613-402f-b6d3-68c16de48090 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043878 Aug 31 13:46:34.280389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 565/1102] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:34 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:46:34.414999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:34.416020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:34.422454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.422898 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.423669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.424110 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.453622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-71f0a1a5-4921-4f0d-9133-cd6bd311425b tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042316 Aug 31 13:46:34.454081 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 538/1103] 10.222.0.21 () {58 vars in 1302 bytes} [Tue Aug 31 13:46:34 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:46:34.529464 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:34.530182 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:34.539359 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.540024 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.541272 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.541829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.569455 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:46:34.652916 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fa7d27af-40a1-43a5-b5fa-666d72eaef79 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 204 len: 0 microversion: 2.1 time: 0.129087 Aug 31 13:46:34.653543 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 566/1104] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:46:34 2021] DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:46:34.661846 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:34.662482 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:34.668544 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.669011 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.669766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:34.670200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:34.822161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:34.835369 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-78703029-c566-49ff-aa4c-fd7c1b252e66 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1675 microversion: 2.1 time: 0.176831 Aug 31 13:46:34.836162 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 539/1105] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:34 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1675 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:35.038897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:35.039779 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:35.049035 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:35.049693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:35.050833 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:35.051486 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:35.079837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:46:35.167827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5930eb4a-4e30-476e-b268-3fcdc0edfa76 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "DELETE /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 204 len: 0 microversion: 2.1 time: 0.135143 Aug 31 13:46:35.168829 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 567/1106] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:46:35 2021] DELETE /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:46:35.178305 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:35.178851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:35.184849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:35.185295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:35.186055 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:35.186483 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:35.332361 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:35.341455 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-94b03210-9a42-4483-a4cb-73763a55356d tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1554 microversion: 2.1 time: 0.167041 Aug 31 13:46:35.342155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 540/1107] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:35 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1554 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:35.857437 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:35.858146 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:35.864822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:35.865263 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:35.866058 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:35.866482 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:36.024202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:36.032627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-63c9966f-3223-4362-bdc1-5c91fdf62ded tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1675 microversion: 2.1 time: 0.179341 Aug 31 13:46:36.033330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 568/1108] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:35 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:36.366270 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:36.367233 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:36.376536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:36.377201 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:36.377746 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:36.378163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:36.531816 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:36.541713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-71877696-a3d0-4940-98fe-04d8f1dbb24e tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1554 microversion: 2.1 time: 0.180306 Aug 31 13:46:36.542287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 541/1109] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:36 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1554 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:37.052917 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:37.053531 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:37.060733 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:37.061195 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:37.061974 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:37.062442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:37.198511 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:37.205320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6af7c90c-ebf1-41a9-a53e-db0e35341bcb tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1675 microversion: 2.1 time: 0.158095 Aug 31 13:46:37.205914 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 569/1110] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:37 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1675 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:37.559095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:37.559690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:37.566005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:37.566511 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:37.567316 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:37.568148 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:37.810705 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f4da27ae43cd4d5daab0dbdf31437832', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '60c6a57cd6ad45bfa5a8e6639416cc35', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:37.818916 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-71bf12df-f12e-45c7-b7cc-84def87aa110 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 200 len: 1554 microversion: 2.1 time: 0.263487 Aug 31 13:46:37.819494 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 542/1111] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:37 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 1554 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:38.006373 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-e14d5f72-a38d-449f-b91c-e2ef2542f54d req-40e7b0c1-fe9f-49a6-9936-7a24b0811441 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "12a13a96-7d73-4f6d-b0a8-266b6ee65761", "name": "network-vif-deleted", "tag": "34eff954-6b81-42e0-814c-eed66d639575"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:38.008589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:38.008589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:46:38.027743 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-e14d5f72-a38d-449f-b91c-e2ef2542f54d req-40e7b0c1-fe9f-49a6-9936-7a24b0811441 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:38.028281 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-e14d5f72-a38d-449f-b91c-e2ef2542f54d req-40e7b0c1-fe9f-49a6-9936-7a24b0811441 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:38.051428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-e14d5f72-a38d-449f-b91c-e2ef2542f54d req-40e7b0c1-fe9f-49a6-9936-7a24b0811441 service nova] Creating event network-vif-deleted:34eff954-6b81-42e0-814c-eed66d639575 for instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 on hv-cinder-80660 Aug 31 13:46:38.057937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-e14d5f72-a38d-449f-b91c-e2ef2542f54d req-40e7b0c1-fe9f-49a6-9936-7a24b0811441 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055721 Aug 31 13:46:38.063499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 570/1112] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:38.223993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:38.224833 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:38.233333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:38.234056 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:38.235171 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:38.235798 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:38.263400 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-d3ba7376-f008-419c-ae4b-65f87b452c64 req-98a437a6-0ad9-4ba1-80ae-67db24ab9835 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91", "name": "network-vif-deleted", "tag": "63dd5148-73a2-4a63-82b7-9ff29b225fee"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:38.264982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:38.264982 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:46:38.273428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d3ba7376-f008-419c-ae4b-65f87b452c64 req-98a437a6-0ad9-4ba1-80ae-67db24ab9835 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:38.273874 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d3ba7376-f008-419c-ae4b-65f87b452c64 req-98a437a6-0ad9-4ba1-80ae-67db24ab9835 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:38.288922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-d3ba7376-f008-419c-ae4b-65f87b452c64 req-98a437a6-0ad9-4ba1-80ae-67db24ab9835 service nova] Creating event network-vif-deleted:63dd5148-73a2-4a63-82b7-9ff29b225fee for instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 on hv-cinder-80660 Aug 31 13:46:38.303087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-d3ba7376-f008-419c-ae4b-65f87b452c64 req-98a437a6-0ad9-4ba1-80ae-67db24ab9835 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043492 Aug 31 13:46:38.304099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 571/1113] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:38 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:46:38.314144 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf0bbd19382494aa7e4c3dc4cb976d9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'effc0a7a4ced437a90c0e75a20033c1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:38.337947 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2a578246-d1ed-4b1f-bdbc-6a9c1274580d tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 200 len: 1608 microversion: 2.1 time: 0.118661 Aug 31 13:46:38.344782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 543/1114] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:38 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 1608 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:38.840039 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:38.840965 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] [instance: 12a13a96-7d73-4f6d-b0a8-266b6ee65761] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:38.850021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:38.850807 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:38.852209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:38.853012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:38.885002 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] HTTP exception thrown: Instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 could not be found. Aug 31 13:46:38.886517 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Returning 404 to user: Instance 12a13a96-7d73-4f6d-b0a8-266b6ee65761 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:38.888008 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e76c53d4-1fb8-47a4-99fc-77de5f92b1ca tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761" status: 404 len: 111 microversion: 2.1 time: 0.055448 Aug 31 13:46:38.889071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 572/1115] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:38 2021] GET /compute/v2.1/servers/12a13a96-7d73-4f6d-b0a8-266b6ee65761 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:38.906241 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9fb6b1b4-e089-489f-9840-3e9c8e106333 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] Calling method '.version_select at 0x7f67f4b75820>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:38.929550 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9fb6b1b4-e089-489f-9840-3e9c8e106333 tempest-TestMinimumBasicScenario-628269536 tempest-TestMinimumBasicScenario-628269536-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-447308117" status: 202 len: 0 microversion: 2.1 time: 0.030765 Aug 31 13:46:38.930594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 544/1116] 10.222.0.21 () {58 vars in 1269 bytes} [Tue Aug 31 13:46:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-447308117 => generated 0 bytes in 33 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:39.358050 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:39.359776 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:39.365167 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:39.365725 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:39.366684 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:39.367204 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:39.382759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] HTTP exception thrown: Instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 could not be found. Aug 31 13:46:39.383382 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Returning 404 to user: Instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:39.384262 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-075ee118-0ceb-4aea-9dfb-fcce69e91804 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 404 len: 111 microversion: 2.1 time: 0.030638 Aug 31 13:46:39.388427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 573/1117] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:39 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 31 13:46:39.393891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-07c5f6cf-4f03-41b8-bd0a-c3262d1df4a6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '.version_select at 0x7f67f4173c10>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:39.415290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-07c5f6cf-4f03-41b8-bd0a-c3262d1df4a6 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392998516" status: 202 len: 0 microversion: 2.1 time: 0.025392 Aug 31 13:46:39.416150 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 545/1118] 10.222.0.21 () {58 vars in 1221 bytes} [Tue Aug 31 13:46:39 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1392998516 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:42.667553 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:42.668520 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:42.674812 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:42.675259 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:42.677260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:42.677791 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:42.695247 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] HTTP exception thrown: Instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 could not be found. Aug 31 13:46:42.696054 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Returning 404 to user: Instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:42.697216 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6d8ca5eb-2ba1-4d8d-b6ab-8614b86ffe36 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 404 len: 111 microversion: 2.1 time: 0.033604 Aug 31 13:46:42.698759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 574/1119] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:46:42 2021] DELETE /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:42.706226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:42.707587 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:42.714795 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:42.715465 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:42.716469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:42.717060 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:42.734015 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] HTTP exception thrown: Instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 could not be found. Aug 31 13:46:42.734622 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Returning 404 to user: Instance fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:42.739218 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-38646f82-1b93-4fae-8af0-baa13ad5164e tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91" status: 404 len: 111 microversion: 2.1 time: 0.033085 Aug 31 13:46:42.739467 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 546/1120] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:42 2021] GET /compute/v2.1/servers/fa0ebeec-cbcf-4b7b-9ab4-db8a9813fd91 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:43.921861 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:43.922403 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:43.928736 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:43.929180 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:43.929952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:43.930383 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:43.944257 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] HTTP exception thrown: Instance 600915c4-ecf3-4004-8c57-260a462152a7 could not be found. Aug 31 13:46:43.944923 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Returning 404 to user: Instance 600915c4-ecf3-4004-8c57-260a462152a7 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:43.945739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0fd4e9ad-6d83-4409-a3f8-92f81865dcb1 tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "DELETE /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 404 len: 111 microversion: 2.1 time: 0.027571 Aug 31 13:46:43.946316 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 575/1121] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:46:43 2021] DELETE /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:43.954185 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:43.954865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] [instance: 600915c4-ecf3-4004-8c57-260a462152a7] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:43.960935 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:43.961373 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:43.962141 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:43.962560 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:43.976059 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] HTTP exception thrown: Instance 600915c4-ecf3-4004-8c57-260a462152a7 could not be found. Aug 31 13:46:43.976687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] Returning 404 to user: Instance 600915c4-ecf3-4004-8c57-260a462152a7 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:43.977507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-64ffd2fc-5c4c-424c-ab01-e740b08659ef tempest-AttachVolumeTestJSON-1202834005 tempest-AttachVolumeTestJSON-1202834005-project] 10.222.0.21 "GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7" status: 404 len: 111 microversion: 2.1 time: 0.027122 Aug 31 13:46:43.978048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 547/1122] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:43 2021] GET /compute/v2.1/servers/600915c4-ecf3-4004-8c57-260a462152a7 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:48.415178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:48.416075 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:48.422796 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:48.423453 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:48.424413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:48.424832 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:48.459832 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e8e0193f-5690-4d93-9b67-1548ef615fb8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.049050 Aug 31 13:46:48.460649 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 576/1123] 10.222.0.21 () {60 vars in 1343 bytes} [Tue Aug 31 13:46:48 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:46:48.526079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:48.526631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:48.532726 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:48.533282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:48.534286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:48.534847 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:48.562181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:46:48.650418 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6796fffc-e02f-44ae-bd90-9809ba2b7711 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 204 len: 0 microversion: 2.20 time: 0.128051 Aug 31 13:46:48.651566 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 548/1124] 10.222.0.21 () {60 vars in 1280 bytes} [Tue Aug 31 13:46:48 2021] DELETE /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:46:48.669012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:48.669646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:48.677963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:48.678652 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:48.680148 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:48.680647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:48.895578 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:48.905492 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:48.906379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:48.907641 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c170b830-ffd8-4589-9ed1-6b3638962bee tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.250077 Aug 31 13:46:48.918958 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 577/1125] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:48 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:49.927641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:49.929102 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:49.938687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:49.939213 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:49.940094 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:49.940671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:50.086380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:50.097709 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:50.099545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:50.100904 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b3fcce3c-7c97-4e47-bd40-39722020d34a tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1722 microversion: 2.20 time: 0.178443 Aug 31 13:46:50.101722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 549/1126] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:49 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1722 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:50.907678 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-e55e26e7-b208-499d-8c40-f688d1562d78 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Action: 'create', calling method: .version_select at 0x7f67f44084c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1803093555"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:51.121134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:51.122353 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:51.129208 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:51.129492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:51.130521 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:51.130946 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:51.235716 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:51.252781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:51.254563 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'efd51ea7f4e849538be43d6164cb1a30', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed036eb1dc894a28af566c40419db15a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:46:51.256067 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-47b03a65-06d3-4f56-b248-c10c09fa43da tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 200 len: 1655 microversion: 2.20 time: 0.138495 Aug 31 13:46:51.266793 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 550/1127] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:51 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 1655 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 31 13:46:51.296280 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-e55e26e7-b208-499d-8c40-f688d1562d78 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.512604 Aug 31 13:46:51.296987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 578/1128] 10.222.0.21 () {60 vars in 1155 bytes} [Tue Aug 31 13:46:50 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 514 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 31 13:46:51.317369 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6a94f1fe-72ed-4b01-9ccc-525613eae628 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f41738b0>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:51.386823 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6a94f1fe-72ed-4b01-9ccc-525613eae628 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 200 len: 345 microversion: 2.1 time: 0.077336 Aug 31 13:46:51.387980 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 551/1129] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:46:51 2021] GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:51.566450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-a04ccbcd-ebbe-4ee7-8d84-411996ad23fb req-f80d2c9c-d244-4d64-bd33-cacbcba9f04e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "394c001c-7443-4fbe-9741-08c461d452f0", "name": "network-vif-deleted", "tag": "0a0e4a75-26c2-4ef4-8023-0cd4f080b64d"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:51.568199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:46:51.568199 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:46:51.577242 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-a04ccbcd-ebbe-4ee7-8d84-411996ad23fb req-f80d2c9c-d244-4d64-bd33-cacbcba9f04e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:51.578191 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-a04ccbcd-ebbe-4ee7-8d84-411996ad23fb req-f80d2c9c-d244-4d64-bd33-cacbcba9f04e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:51.591299 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-a04ccbcd-ebbe-4ee7-8d84-411996ad23fb req-f80d2c9c-d244-4d64-bd33-cacbcba9f04e service nova] Creating event network-vif-deleted:0a0e4a75-26c2-4ef4-8023-0cd4f080b64d for instance 394c001c-7443-4fbe-9741-08c461d452f0 on hv-cinder-80660 Aug 31 13:46:51.597668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-a04ccbcd-ebbe-4ee7-8d84-411996ad23fb req-f80d2c9c-d244-4d64-bd33-cacbcba9f04e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036729 Aug 31 13:46:51.598278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 579/1130] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:46:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:52.274939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:52.275656 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:52.281816 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:52.282263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:52.283005 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:52.283428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:52.297461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] HTTP exception thrown: Instance 394c001c-7443-4fbe-9741-08c461d452f0 could not be found. Aug 31 13:46:52.298048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Returning 404 to user: Instance 394c001c-7443-4fbe-9741-08c461d452f0 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:52.298866 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-cfa78236-7f7c-46fd-9d50-665b7b4fe452 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 404 len: 111 microversion: 2.20 time: 0.027926 Aug 31 13:46:52.299540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 552/1131] 10.222.0.21 () {60 vars in 1277 bytes} [Tue Aug 31 13:46:52 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 31 13:46:52.310187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c6a841df-73a5-4443-9952-361ba75e1bf8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '.version_select at 0x7f67f4298ca0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:52.331594 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c6a841df-73a5-4443-9952-361ba75e1bf8 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-809990844" status: 204 len: 0 microversion: 2.20 time: 0.026060 Aug 31 13:46:52.332421 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 580/1132] 10.222.0.21 () {60 vars in 1259 bytes} [Tue Aug 31 13:46:52 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-809990844 => generated 0 bytes in 28 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 31 13:46:52.400595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d7b36124-4b0d-4a1d-9bcc-91f66de96d4b tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f41cfb80>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:52.472656 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d7b36124-4b0d-4a1d-9bcc-91f66de96d4b tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 200 len: 346 microversion: 2.1 time: 0.077134 Aug 31 13:46:52.473187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 553/1133] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:46:52 2021] GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 346 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:52.485218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-936f3c45-71df-4793-bb76-f597abcff0de tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Action: 'create', calling method: .version_select at 0x7f67f4308ee0>, body: {"snapshot": {"volume_id": "bb40af50-ef9b-4acb-8f6b-ddecebca0367", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1915053726"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:46:52.707472 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-936f3c45-71df-4793-bb76-f597abcff0de tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.223999 Aug 31 13:46:52.708221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 581/1134] 10.222.0.21 () {60 vars in 1162 bytes} [Tue Aug 31 13:46:52 2021] POST /compute/v2.1/os-snapshots => generated 287 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:52.719341 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b9edc305-4eb1-450f-b102-faafc922c953 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f4b7a040>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:52.751411 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b9edc305-4eb1-450f-b102-faafc922c953 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 287 microversion: 2.1 time: 0.036683 Aug 31 13:46:52.751976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 554/1135] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:52 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:46:52.762809 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c6927057-3c82-47f3-a2b5-ce7098390ebe tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42a24c0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:52.801070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c6927057-3c82-47f3-a2b5-ce7098390ebe tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.042713 Aug 31 13:46:52.801650 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 582/1136] 10.222.0.21 () {58 vars in 1140 bytes} [Tue Aug 31 13:46:52 2021] GET /compute/v2.1/os-snapshots => generated 290 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:52.812467 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4c9df4fe-7f90-425c-b9bf-a1928aaa4054 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f4173b80>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:52.848239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4c9df4fe-7f90-425c-b9bf-a1928aaa4054 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 287 microversion: 2.1 time: 0.039353 Aug 31 13:46:52.849004 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 555/1137] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:52 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:53.860389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-770b20cf-48a3-4b1a-966a-22d8422fa72c tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42a2dc0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:53.892055 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-770b20cf-48a3-4b1a-966a-22d8422fa72c tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 287 microversion: 2.1 time: 0.035399 Aug 31 13:46:53.892674 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 583/1138] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:53 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:54.904987 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-92d26144-eb43-4bf9-a934-692ec77bbc28 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42e5700>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:54.936297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-92d26144-eb43-4bf9-a934-692ec77bbc28 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 287 microversion: 2.1 time: 0.035189 Aug 31 13:46:54.936903 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 556/1139] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:54 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:55.948339 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-dcc510bd-be83-4ebc-a662-00984088b240 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42d19d0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:55.981197 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-dcc510bd-be83-4ebc-a662-00984088b240 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 287 microversion: 2.1 time: 0.036398 Aug 31 13:46:55.981771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 584/1140] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:55 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:56.995752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f032b289-de4e-4059-9c13-1f615b375ef4 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f41cf670>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:57.031596 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f032b289-de4e-4059-9c13-1f615b375ef4 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 288 microversion: 2.1 time: 0.039581 Aug 31 13:46:57.032453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 557/1141] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:56 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 288 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:57.042872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4245193c-3793-4426-a7b2-ab0ad580a8c7 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f425a3a0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:57.111027 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4245193c-3793-4426-a7b2-ab0ad580a8c7 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "DELETE /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 202 len: 0 microversion: 2.1 time: 0.071918 Aug 31 13:46:57.115747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 585/1142] 10.222.0.21 () {58 vars in 1254 bytes} [Tue Aug 31 13:46:57 2021] DELETE /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:57.120883 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f52258f6-bc6f-49f5-891f-7e9be09cc2e6 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f4173700>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:57.153437 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f52258f6-bc6f-49f5-891f-7e9be09cc2e6 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 200 len: 287 microversion: 2.1 time: 0.036133 Aug 31 13:46:57.154143 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 558/1143] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:57 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 287 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:57.418256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:57.418897 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:57.426030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:57.426478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:57.427246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:57.427681 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:57.440772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] HTTP exception thrown: Instance 394c001c-7443-4fbe-9741-08c461d452f0 could not be found. Aug 31 13:46:57.441221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Returning 404 to user: Instance 394c001c-7443-4fbe-9741-08c461d452f0 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:57.442042 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b4cec8b6-86a3-489d-b915-e3219587ae7b tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 404 len: 111 microversion: 2.1 time: 0.027535 Aug 31 13:46:57.442564 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 586/1144] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:46:57 2021] DELETE /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:57.453385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:57.454243 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 394c001c-7443-4fbe-9741-08c461d452f0] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:57.462092 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:57.462536 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:57.463297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:57.463728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:57.477111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] HTTP exception thrown: Instance 394c001c-7443-4fbe-9741-08c461d452f0 could not be found. Aug 31 13:46:57.477720 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Returning 404 to user: Instance 394c001c-7443-4fbe-9741-08c461d452f0 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:57.478519 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e1bdb2c5-6aab-46e3-89a9-85d9c1b2da92 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0" status: 404 len: 111 microversion: 2.1 time: 0.031009 Aug 31 13:46:57.479057 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 559/1145] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:57 2021] GET /compute/v2.1/servers/394c001c-7443-4fbe-9741-08c461d452f0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:58.164863 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ace8caa6-c318-492d-b406-cc3d1a8c6d8e tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42d1670>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:58.196279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-ace8caa6-c318-492d-b406-cc3d1a8c6d8e tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] HTTP exception thrown: Snapshot 82f7d1f0-079a-41e3-997e-f450e7f2bf3a could not be found. Aug 31 13:46:58.196938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ace8caa6-c318-492d-b406-cc3d1a8c6d8e tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Returning 404 to user: Snapshot 82f7d1f0-079a-41e3-997e-f450e7f2bf3a could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:58.197764 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ace8caa6-c318-492d-b406-cc3d1a8c6d8e tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a" status: 404 len: 111 microversion: 2.1 time: 0.036693 Aug 31 13:46:58.198296 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 587/1146] 10.222.0.21 () {58 vars in 1251 bytes} [Tue Aug 31 13:46:58 2021] GET /compute/v2.1/os-snapshots/82f7d1f0-079a-41e3-997e-f450e7f2bf3a => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:58.206898 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b48be535-67ed-44ac-a64f-5e954e7fad3c tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f41cfee0>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:58.276562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b48be535-67ed-44ac-a64f-5e954e7fad3c tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 202 len: 0 microversion: 2.1 time: 0.073470 Aug 31 13:46:58.277127 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 560/1147] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 31 13:46:58 2021] DELETE /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 0 bytes in 75 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:46:58.285643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-1df49889-b8d4-4e2c-adaf-ae2385cb5d13 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42a20d0>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:58.338619 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-1df49889-b8d4-4e2c-adaf-ae2385cb5d13 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 200 len: 345 microversion: 2.1 time: 0.056607 Aug 31 13:46:58.339256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 588/1148] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:46:58 2021] GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:46:58.641882 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:58.642388 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:58.651486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:58.652217 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:58.653514 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:58.654178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:58.669677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] HTTP exception thrown: Instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 could not be found. Aug 31 13:46:58.670261 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Returning 404 to user: Instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:58.671079 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7e56ead7-98ac-4556-8a6b-fcf06b4e8962 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "DELETE /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 404 len: 111 microversion: 2.1 time: 0.035184 Aug 31 13:46:58.671647 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 561/1149] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:46:58 2021] DELETE /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:58.682499 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:58.683362 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] [instance: 37ca962d-2198-4c40-ac9b-6ab316ebc725] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:46:58.692522 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:58.693136 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:58.694260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:46:58.694759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:46:58.712830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] HTTP exception thrown: Instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 could not be found. Aug 31 13:46:58.713410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] Returning 404 to user: Instance 37ca962d-2198-4c40-ac9b-6ab316ebc725 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:58.714221 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ea758f26-dce2-49b9-8c1e-7fc9b2fa9806 tempest-AttachVolumeShelveTestJSON-1410486693 tempest-AttachVolumeShelveTestJSON-1410486693-project] 10.222.0.21 "GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725" status: 404 len: 111 microversion: 2.1 time: 0.037935 Aug 31 13:46:58.714727 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 589/1150] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:46:58 2021] GET /compute/v2.1/servers/37ca962d-2198-4c40-ac9b-6ab316ebc725 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:59.351760 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-96b633bf-f850-46cf-8b90-b7335302228f tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f41cf670>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:59.398178 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-96b633bf-f850-46cf-8b90-b7335302228f tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] HTTP exception thrown: Volume bb40af50-ef9b-4acb-8f6b-ddecebca0367 could not be found. Aug 31 13:46:59.399265 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-96b633bf-f850-46cf-8b90-b7335302228f tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Returning 404 to user: Volume bb40af50-ef9b-4acb-8f6b-ddecebca0367 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:59.400781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-96b633bf-f850-46cf-8b90-b7335302228f tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 404 len: 109 microversion: 2.1 time: 0.052580 Aug 31 13:46:59.401448 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 562/1151] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:46:59 2021] GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 109 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:59.415401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-881cbeae-0d6b-4b98-a9c1-99b60be65afb tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f42b8b80>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:59.454220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-881cbeae-0d6b-4b98-a9c1-99b60be65afb tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] HTTP exception thrown: Volume bb40af50-ef9b-4acb-8f6b-ddecebca0367 could not be found. Aug 31 13:46:59.454907 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-881cbeae-0d6b-4b98-a9c1-99b60be65afb tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Returning 404 to user: Volume bb40af50-ef9b-4acb-8f6b-ddecebca0367 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:59.455912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-881cbeae-0d6b-4b98-a9c1-99b60be65afb tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "DELETE /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 404 len: 109 microversion: 2.1 time: 0.044253 Aug 31 13:46:59.457099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 590/1152] 10.222.0.21 () {58 vars in 1248 bytes} [Tue Aug 31 13:46:59 2021] DELETE /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:46:59.467732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-821187bb-3778-4ad3-a1c6-ae8da0abcb75 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Calling method '.version_select at 0x7f67f4b7a040>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:46:59.495355 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-821187bb-3778-4ad3-a1c6-ae8da0abcb75 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] HTTP exception thrown: Volume bb40af50-ef9b-4acb-8f6b-ddecebca0367 could not be found. Aug 31 13:46:59.495976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-821187bb-3778-4ad3-a1c6-ae8da0abcb75 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] Returning 404 to user: Volume bb40af50-ef9b-4acb-8f6b-ddecebca0367 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:46:59.496864 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-821187bb-3778-4ad3-a1c6-ae8da0abcb75 tempest-VolumesSnapshotsTestJSON-1433315751 tempest-VolumesSnapshotsTestJSON-1433315751-project] 10.222.0.21 "GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367" status: 404 len: 109 microversion: 2.1 time: 0.035692 Aug 31 13:46:59.497454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 563/1153] 10.222.0.21 () {58 vars in 1245 bytes} [Tue Aug 31 13:46:59 2021] GET /compute/v2.1/os-volumes/bb40af50-ef9b-4acb-8f6b-ddecebca0367 => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:47:17.823184 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-722369087", "imageRef": "12e919f4-beba-4e25-8b85-1df6beb0d1c6", "flavorRef": "452"}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:47:17.888552 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] validate_networks() for None {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:47:17.955915 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:47:17.956158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:47:17 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.21) !!! Aug 31 13:47:18.187883 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:47:18.188301 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:47:18.188804 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:47:18.189208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:47:18.189621 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:47:18.199395 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:18.199841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:18.200677 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:18.201110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:18.218457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Getting quotas for project 48b92520beba4f50b17240fb166d6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:47:18.222491 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Getting quotas for user d19e8ae112b242dc9ebf279c0659c484 and project 48b92520beba4f50b17240fb166d6f09. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:47:18.234038 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:47:18.236397 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='12e919f4-beba-4e25-8b85-1df6beb0d1c6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:47:18.288831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-0c08c4da-97d2-44d5-931b-a0ce836ef818 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.469735 Aug 31 13:47:18.289461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 591/1154] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:47:17 2021] POST /compute/v2.1/servers => generated 380 bytes in 471 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:47:18.299844 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-77bf9af9-7aee-4d4b-9728-adb183586377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:18.300486 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-77bf9af9-7aee-4d4b-9728-adb183586377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:18.355917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-77bf9af9-7aee-4d4b-9728-adb183586377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:18.362695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-77bf9af9-7aee-4d4b-9728-adb183586377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1214 microversion: 2.1 time: 0.067068 Aug 31 13:47:18.363264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 564/1155] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:18 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1214 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:19.379478 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:19.380144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:19.386211 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:19.386680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:19.387439 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:19.388013 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:19.465848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:19.473420 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-89e2755e-003e-41eb-8b48-e702e3a1cac4 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1272 microversion: 2.1 time: 0.097813 Aug 31 13:47:19.474320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 592/1156] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:19 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1272 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:20.491134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:20.491773 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:20.498395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:20.498841 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:20.500224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:20.500690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:20.723586 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:20.732049 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-092a6bb5-088f-4f15-baf5-16a670d50377 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1314 microversion: 2.1 time: 0.244818 Aug 31 13:47:20.732929 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 565/1157] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:20 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:20.942253 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-8139ec4d-9068-474a-9fad-66843027cbf2 req-985f6106-dd06-4d0d-95ed-86b06c69e153 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8", "tag": "fb9cbe89-af62-48b8-806e-b59a5a524a11"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:47:20.944585 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:47:20.944585 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:47:20.956065 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-8139ec4d-9068-474a-9fad-66843027cbf2 req-985f6106-dd06-4d0d-95ed-86b06c69e153 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:20.956826 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-8139ec4d-9068-474a-9fad-66843027cbf2 req-985f6106-dd06-4d0d-95ed-86b06c69e153 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:20.979409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-8139ec4d-9068-474a-9fad-66843027cbf2 req-985f6106-dd06-4d0d-95ed-86b06c69e153 service nova] Creating event network-changed:fb9cbe89-af62-48b8-806e-b59a5a524a11 for instance ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 on hv-cinder-80660 Aug 31 13:47:20.987269 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-8139ec4d-9068-474a-9fad-66843027cbf2 req-985f6106-dd06-4d0d-95ed-86b06c69e153 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053686 Aug 31 13:47:20.988217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 593/1158] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:47:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:47:21.750263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:21.750851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:21.756876 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:21.757327 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:21.758160 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:21.758564 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:21.974365 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:21.982861 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c26687a5-9962-4721-8d86-925eb3f7d23a tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1314 microversion: 2.1 time: 0.236952 Aug 31 13:47:21.983478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 566/1159] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:21 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:23.002442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:23.003382 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:23.010220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:23.010709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:23.011487 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:23.011925 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:23.155783 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:23.164949 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-103aed10-33df-4c4f-bb85-fa2de5679d20 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1314 microversion: 2.1 time: 0.167027 Aug 31 13:47:23.166126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 594/1160] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:22 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:24.183307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:24.183902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:24.191463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:24.191895 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:24.192770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:24.193204 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:24.345442 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:24.354344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-576a4497-17c2-460f-b5d6-f0f3c29b5fdc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1314 microversion: 2.1 time: 0.174750 Aug 31 13:47:24.363766 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 567/1161] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:24 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:24.394003 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-e2f5efbd-452d-4822-88b1-29fdc55d7762 req-f4cb2818-6037-4710-abb3-ce6333fdfd67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8", "name": "network-vif-plugged", "status": "completed", "tag": "fb9cbe89-af62-48b8-806e-b59a5a524a11"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:47:24.396283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:47:24.396283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:47:24.404354 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-e2f5efbd-452d-4822-88b1-29fdc55d7762 req-f4cb2818-6037-4710-abb3-ce6333fdfd67 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:24.404983 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-e2f5efbd-452d-4822-88b1-29fdc55d7762 req-f4cb2818-6037-4710-abb3-ce6333fdfd67 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:24.419827 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-e2f5efbd-452d-4822-88b1-29fdc55d7762 req-f4cb2818-6037-4710-abb3-ce6333fdfd67 service nova] Creating event network-vif-plugged:fb9cbe89-af62-48b8-806e-b59a5a524a11 for instance ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 on hv-cinder-80660 Aug 31 13:47:24.425822 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-e2f5efbd-452d-4822-88b1-29fdc55d7762 req-f4cb2818-6037-4710-abb3-ce6333fdfd67 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035630 Aug 31 13:47:24.426693 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 595/1162] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:47:24 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:47:25.371981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:25.372621 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:25.380021 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:25.380783 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:25.381826 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:25.382239 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:25.522607 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:25.530665 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-7c4ad1e6-ac13-48e6-b67a-339b12f886ea tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1314 microversion: 2.1 time: 0.162993 Aug 31 13:47:25.532277 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 568/1163] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:25 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:26.555985 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:26.555985 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:26.565154 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:26.565622 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:26.566425 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:26.566852 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:26.719856 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:26.729179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f8bf4ec8-4c73-4181-9fd3-6b65555eb1a0 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1464 microversion: 2.1 time: 0.180063 Aug 31 13:47:26.729769 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 596/1164] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:26 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1464 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:47:26.785249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:26.786213 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:26.798290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:26.798290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:26.798290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:26.798290 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:26.831477 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:47:26.942211 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d3c9a89f-bcc0-4023-a10d-05ffa2e3a970 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "DELETE /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 204 len: 0 microversion: 2.1 time: 0.163296 Aug 31 13:47:26.942956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 569/1165] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:47:26 2021] DELETE /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:47:26.951321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:26.951937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:26.958788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:26.959428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:26.960187 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:26.960760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:27.111896 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:27.124788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-4b717c93-19eb-49f9-9eb0-db6bb3ae9c6f tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1470 microversion: 2.1 time: 0.176490 Aug 31 13:47:27.125494 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 597/1166] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:26 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1470 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:28.146328 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:28.147381 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:28.155242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:28.155693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:28.157007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:28.157645 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:28.289575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:28.301177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b7c22b9a-e74d-4563-976c-840cee3c4fd6 tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1470 microversion: 2.1 time: 0.158732 Aug 31 13:47:28.301932 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 570/1167] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:28 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1470 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:28.847942 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-32993b99-2afe-4f98-a84c-7dca42050604 req-e13225f4-5f8e-4616-b17a-7a8b3c651fce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8", "name": "network-vif-deleted", "tag": "fb9cbe89-af62-48b8-806e-b59a5a524a11"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:47:28.849772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:47:28.849772 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:47:28.857306 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-32993b99-2afe-4f98-a84c-7dca42050604 req-e13225f4-5f8e-4616-b17a-7a8b3c651fce service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:28.857760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-32993b99-2afe-4f98-a84c-7dca42050604 req-e13225f4-5f8e-4616-b17a-7a8b3c651fce service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:28.872169 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-32993b99-2afe-4f98-a84c-7dca42050604 req-e13225f4-5f8e-4616-b17a-7a8b3c651fce service nova] Creating event network-vif-deleted:fb9cbe89-af62-48b8-806e-b59a5a524a11 for instance ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 on hv-cinder-80660 Aug 31 13:47:28.878305 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-32993b99-2afe-4f98-a84c-7dca42050604 req-e13225f4-5f8e-4616-b17a-7a8b3c651fce service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033028 Aug 31 13:47:28.878305 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 598/1168] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:47:28 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:47:29.323264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:29.324029 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:29.329821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:29.330253 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:29.331019 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:29.331453 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:29.366243 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:29.366677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:29.367128 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lazy-loading 'fault' on Instance uuid ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:47:29.408747 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd19e8ae112b242dc9ebf279c0659c484', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48b92520beba4f50b17240fb166d6f09', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:47:29.417153 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c7ba18de-c40d-436f-801e-95ad8271bffa tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 200 len: 1304 microversion: 2.1 time: 0.097607 Aug 31 13:47:29.417788 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 571/1169] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:29 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:47:30.438260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:47:30.438950 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] [instance: ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:47:30.445615 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:30.446053 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:30.446904 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:47:30.447342 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:47:30.460877 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] HTTP exception thrown: Instance ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 could not be found. Aug 31 13:47:30.461445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] Returning 404 to user: Instance ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:47:30.462406 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-6e2b161f-f5dc-44ba-af1a-bfc538afe2bc tempest-VolumesNegativeTest-1304779794 tempest-VolumesNegativeTest-1304779794-project] 10.222.0.21 "GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8" status: 404 len: 111 microversion: 2.1 time: 0.028125 Aug 31 13:47:30.462946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 599/1170] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:47:30 2021] GET /compute/v2.1/servers/ef33027d-6d9e-491f-9f93-ddf0dbcf4cd8 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:47:46.206215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c7f67430-ce21-4c23-8477-e68c3f15a1e2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Action: 'create', calling method: .version_select at 0x7f67f4173e50>, body: {"keypair": {"name": "tempest-TestShelveInstance-1503517526"}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:47:46.228564 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-c7f67430-ce21-4c23-8477-e68c3f15a1e2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Getting quotas for project bbf3fe9318e24c7e9c50ba3a63ba6260. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:47:46.236524 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-c7f67430-ce21-4c23-8477-e68c3f15a1e2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Getting quotas for user f54416f992314a0db756001419024c54 and project bbf3fe9318e24c7e9c50ba3a63ba6260. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:47:46.686595 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-c7f67430-ce21-4c23-8477-e68c3f15a1e2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Getting quotas for project bbf3fe9318e24c7e9c50ba3a63ba6260. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:47:46.690485 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-c7f67430-ce21-4c23-8477-e68c3f15a1e2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Getting quotas for user f54416f992314a0db756001419024c54 and project bbf3fe9318e24c7e9c50ba3a63ba6260. Resources: {'key_pairs'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:47:46.711294 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c7f67430-ce21-4c23-8477-e68c3f15a1e2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.673390 Aug 31 13:47:46.711894 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 572/1171] 10.222.0.21 () {60 vars in 1158 bytes} [Tue Aug 31 13:47:46 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:03.725497 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-133641823", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1084113261", "security_groups": [{"name": "tempest-secgroup-smoke-2048621792"}], "block_device_mapping_v2": [{"uuid": "ae6382fa-69c6-477d-a732-581662f55bfa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "eadfe07a-649e-4ecc-ab96-dbd117253913"}]}} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:03.847673 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.network.neutron [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] validate_networks() for [('eadfe07a-649e-4ecc-ab96-dbd117253913', None, None, None, None, None)] {{(pid=120181) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:48:04.251090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Flavor limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:48:04.251593 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Image limits 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:48:04.252140 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Flavor pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:48:04.252639 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Image pref 0:0:0 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:48:04.253139 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.virt.hardware [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120181) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:48:04.262245 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:04.262691 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:04.263475 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:04.263912 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:04.281085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:48:04.285157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.quota [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Getting quotas for user 83dc5c95f312476599549f1901dbe9ff and project 3fe0f9f3a4c9445aa52a0cd9c16de325. Resources: {'ram', 'cores', 'instances'} {{(pid=120181) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:48:04.357483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Going to run 1 instances... {{(pid=120181) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:48:04.359834 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ae6382fa-69c6-477d-a732-581662f55bfa',volume_size=None,volume_type=None)] {{(pid=120181) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:48:04.510784 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-92452da4-d56d-484c-8008-dd2629782952 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.789301 Aug 31 13:48:04.511595 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 600/1172] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:48:03 2021] POST /compute/v2.1/servers => generated 406 bytes in 791 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:48:04.521817 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-9def005e-1e46-4c5a-8b6e-9053a3c36973 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:04.522475 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-9def005e-1e46-4c5a-8b6e-9053a3c36973 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:04.576562 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-9def005e-1e46-4c5a-8b6e-9053a3c36973 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:04.583693 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-9def005e-1e46-4c5a-8b6e-9053a3c36973 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1094 microversion: 2.1 time: 0.065658 Aug 31 13:48:04.584246 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 573/1173] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:04 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:05.602738 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-aea2e209-ce51-4038-84e1-a657db5c0934 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:05.603308 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-aea2e209-ce51-4038-84e1-a657db5c0934 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:05.670352 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-aea2e209-ce51-4038-84e1-a657db5c0934 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:05.678919 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-aea2e209-ce51-4038-84e1-a657db5c0934 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1094 microversion: 2.1 time: 0.080543 Aug 31 13:48:05.679548 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 601/1174] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:05 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1094 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:06.698968 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b48fbf18-b1e2-4072-9803-f39398bf18f5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:06.699862 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b48fbf18-b1e2-4072-9803-f39398bf18f5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:06.755629 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b48fbf18-b1e2-4072-9803-f39398bf18f5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:06.765819 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b48fbf18-b1e2-4072-9803-f39398bf18f5 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1094 microversion: 2.1 time: 0.071816 Aug 31 13:48:06.766423 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 574/1175] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:06 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1094 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:07.783411 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:07.784268 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:07.792266 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:07.792793 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:07.794651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:07.794651 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:07.868006 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:07.875747 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a32b2eaf-82e8-4d16-ab52-25ed6a2cd32b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1210 microversion: 2.1 time: 0.096390 Aug 31 13:48:07.885648 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 602/1176] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:07 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1210 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:08.894473 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:08.895102 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:08.903538 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:08.903981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:08.905402 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:08.905770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:09.123255 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:09.147155 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5005da2a-1870-4a89-bc1d-adf45f569c37 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.255100 Aug 31 13:48:09.148209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 575/1177] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:08 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:09.222994 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-55fbe139-b415-4912-82a0-91378313031b req-40a62801-3157-4c2d-b259-9f50072eedc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493cb2a1-d0f0-43dd-a01f-b65f048239b1", "tag": "f0d34555-bccb-4b50-b67c-fdb8da5013fe"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:09.226625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:48:09.226625 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:48:09.234965 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-55fbe139-b415-4912-82a0-91378313031b req-40a62801-3157-4c2d-b259-9f50072eedc6 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:09.235493 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-55fbe139-b415-4912-82a0-91378313031b req-40a62801-3157-4c2d-b259-9f50072eedc6 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:09.255329 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-55fbe139-b415-4912-82a0-91378313031b req-40a62801-3157-4c2d-b259-9f50072eedc6 service nova] Creating event network-changed:f0d34555-bccb-4b50-b67c-fdb8da5013fe for instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 on hv-cinder-80660 Aug 31 13:48:09.261032 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-55fbe139-b415-4912-82a0-91378313031b req-40a62801-3157-4c2d-b259-9f50072eedc6 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042175 Aug 31 13:48:09.261878 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 603/1178] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:48:09 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:48:09.573640 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1724657967", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1503517526", "security_groups": [{"name": "tempest-secgroup-smoke-927804971"}], "networks": [{"uuid": "871809d3-63b9-4ca5-989f-bcff6ac7ca85"}], "block_device_mapping_v2": [{"uuid": "e55afc5a-352b-4e6a-a7eb-d381eb65dabe", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:09.709594 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.network.neutron [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] validate_networks() for [('871809d3-63b9-4ca5-989f-bcff6ac7ca85', None, None, None, None, None)] {{(pid=120180) validate_networks /opt/stack/nova/nova/network/neutron.py:2361}} Aug 31 13:48:10.166855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:10.167660 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:10.174289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:10.174739 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:10.175518 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:10.176011 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:10.308053 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:10.316505 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fe5e79b0-f389-4d59-b2ad-3a53fef538a3 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.153878 Aug 31 13:48:10.317215 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 604/1179] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:10 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:10.398131 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Flavor limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 31 13:48:10.398648 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Image limits 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 31 13:48:10.399027 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Flavor pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 31 13:48:10.399431 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Image pref 0:0:0 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 31 13:48:10.399840 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.virt.hardware [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120180) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 31 13:48:10.409366 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:10.410139 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:10.411152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:10.411797 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:10.431545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Getting quotas for project bbf3fe9318e24c7e9c50ba3a63ba6260. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:387}} Aug 31 13:48:10.435525 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.quota [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Getting quotas for user f54416f992314a0db756001419024c54 and project bbf3fe9318e24c7e9c50ba3a63ba6260. Resources: {'ram', 'cores', 'instances'} {{(pid=120180) _get_quotas /opt/stack/nova/nova/quota.py:377}} Aug 31 13:48:10.508160 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Going to run 1 instances... {{(pid=120180) _provision_instances /opt/stack/nova/nova/compute/api.py:1315}} Aug 31 13:48:10.511072 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e55afc5a-352b-4e6a-a7eb-d381eb65dabe',volume_size=None,volume_type=None)] {{(pid=120180) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1720}} Aug 31 13:48:10.647892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-64a3f5fd-1a31-451f-8f57-ebd72d686edb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.078101 Aug 31 13:48:10.648781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 576/1180] 10.222.0.21 () {60 vars in 1147 bytes} [Tue Aug 31 13:48:09 2021] POST /compute/v2.1/servers => generated 405 bytes in 1080 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 31 13:48:10.658908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fc92889d-85fb-4206-b664-7e810daee9cd tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:10.659511 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fc92889d-85fb-4206-b664-7e810daee9cd tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:10.716844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fc92889d-85fb-4206-b664-7e810daee9cd tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:10.727172 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fc92889d-85fb-4206-b664-7e810daee9cd tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1089 microversion: 2.1 time: 0.071996 Aug 31 13:48:10.727939 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 605/1181] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:10 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1089 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:11.334225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:11.334813 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:11.341669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:11.342111 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:11.342865 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:11.343323 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:11.482289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:11.490295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-198413f4-a02a-449d-bfff-42d914844056 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.159811 Aug 31 13:48:11.490832 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 577/1182] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:11 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:11.747665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-9b086dc8-a6ac-4e84-bf8c-efd09251780d tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:11.748236 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-9b086dc8-a6ac-4e84-bf8c-efd09251780d tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:11.808557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-9b086dc8-a6ac-4e84-bf8c-efd09251780d tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:11.816274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-9b086dc8-a6ac-4e84-bf8c-efd09251780d tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1089 microversion: 2.1 time: 0.073647 Aug 31 13:48:11.819300 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 606/1183] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:11 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1089 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:12.509442 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:12.510028 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:12.518445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:12.518895 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:12.519669 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:12.520101 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:12.671068 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:12.679542 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-02f8734a-84d2-4794-9d1d-5dce424dd5ae tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.174560 Aug 31 13:48:12.680122 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 578/1184] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:12 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:12.833992 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:12.834609 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:12.841205 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:12.841646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:12.842417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:12.842841 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:12.908479 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:12.916312 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-aa5af433-ae8c-43bf-b9a9-ecb5b639d1e7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1139 microversion: 2.1 time: 0.086143 Aug 31 13:48:12.916948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 607/1185] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:12 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1139 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:13.698547 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:13.699293 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:13.706436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:13.706945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:13.707802 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:13.708243 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:13.902170 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:13.925233 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-dbb0cf35-9b6c-4f2e-a6b6-87272d79fa88 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.226508 Aug 31 13:48:13.926565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 579/1186] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:13 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:13.940557 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:13.941428 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:13.947768 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:13.948510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:13.949392 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:13.949748 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:14.016115 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:14.024473 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-423afbb4-e9e9-46a1-8726-049ef03901f7 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1205 microversion: 2.1 time: 0.087749 Aug 31 13:48:14.025092 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 608/1187] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:13 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1205 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:14.943599 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:14.945131 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:14.951473 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:14.951993 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:14.952892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:14.953313 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:15.042283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:15.043052 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:15.050370 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:15.051313 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:15.052748 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:15.053385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:15.166878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:15.178134 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-75629a36-a9c4-4ab5-a715-db6bad9e089e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.238856 Aug 31 13:48:15.178739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 580/1188] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:14 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:15.199214 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:15.207372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c31db799-c2bf-4290-82a2-d35c685b32e8 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.168814 Aug 31 13:48:15.207955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 609/1189] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:15 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:15.287878 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-2b81015e-e0ba-4383-8fd6-5b924ca5a246 req-f940309c-5755-45d7-8797-11cbfc44bc74 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:15.289780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:48:15.289780 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:48:15.297194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-2b81015e-e0ba-4383-8fd6-5b924ca5a246 req-f940309c-5755-45d7-8797-11cbfc44bc74 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:15.297657 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-2b81015e-e0ba-4383-8fd6-5b924ca5a246 req-f940309c-5755-45d7-8797-11cbfc44bc74 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:15.310800 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-2b81015e-e0ba-4383-8fd6-5b924ca5a246 req-f940309c-5755-45d7-8797-11cbfc44bc74 service nova] Creating event network-changed:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:48:15.318084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-2b81015e-e0ba-4383-8fd6-5b924ca5a246 req-f940309c-5755-45d7-8797-11cbfc44bc74 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034339 Aug 31 13:48:15.318831 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 581/1190] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:48:15 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:48:16.196735 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:16.197821 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:16.204816 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:16.205442 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:16.206211 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:16.206628 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:16.225296 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:16.226646 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:16.232975 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:16.233515 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:16.234388 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:16.234892 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:16.342085 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:16.350136 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-25d87b09-e4ee-4d0d-9077-ac653220f312 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.158319 Aug 31 13:48:16.350864 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 610/1191] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:16 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:16.422195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:16.430395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b737bd1b-5e42-401e-8928-64691100f798 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.209137 Aug 31 13:48:16.430891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 582/1192] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:16 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:17.368636 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:17.369276 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:17.376072 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:17.377106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:17.378126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:17.378560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:17.447704 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:17.448360 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:17.454292 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:17.454799 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:17.455764 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:17.456195 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:17.508330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:17.516389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-8a7dc133-dd15-406b-ad14-72e62c2b5d15 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.151737 Aug 31 13:48:17.517179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 611/1193] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:17 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:17.592692 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:17.602730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-38810cdb-f78f-46c0-9fd8-39255adc67c6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.158105 Aug 31 13:48:17.602730 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 583/1194] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:17 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:18.534999 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:18.536237 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:18.543182 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:18.543938 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:18.544746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:18.545178 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:18.621022 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:18.622641 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:18.630099 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:18.630830 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:18.631888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:18.632602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:18.704122 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:18.714622 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-006cd9e2-f5d3-4dff-8c24-734be9ae2cb2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.184314 Aug 31 13:48:18.716745 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 612/1195] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:18 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:18.793909 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:18.802143 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f5d4e9fc-45c3-4789-bc37-f8689bda5d52 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.186230 Aug 31 13:48:18.802681 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 584/1196] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:18 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:19.731930 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:19.732427 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:19.738993 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:19.739447 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:19.740230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:19.740680 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:19.824024 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:19.826010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:19.831899 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:19.832563 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:19.833459 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:19.833999 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:19.909948 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:19.918799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7a59e284-08cf-44a7-aa41-ee12023607e6 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.190611 Aug 31 13:48:19.919854 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 613/1197] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:19 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:19.988673 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:19.996225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-284e22c6-81f0-489b-afa1-e2b96b892797 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.180561 Aug 31 13:48:19.996821 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 585/1198] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:19 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:20.935837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:20.936488 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:20.949212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:20.949645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:20.950450 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:20.950872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:21.014490 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:21.015152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:21.022434 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:21.022888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:21.024065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:21.024650 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:21.083766 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:21.091788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-7baf254d-fe92-4464-8526-272dbacd908f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.159568 Aug 31 13:48:21.092445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 614/1199] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:20 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:21.160300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:21.167986 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-65c72f25-1371-4e4e-b2b2-66722d0ecaca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.157370 Aug 31 13:48:21.168551 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 586/1200] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:21 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:21.294110 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-0a206820-277a-4333-a330-33630cfc297f req-d569ad6b-eacb-44ba-8567-f0e190c3733f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493cb2a1-d0f0-43dd-a01f-b65f048239b1", "name": "network-vif-plugged", "status": "completed", "tag": "f0d34555-bccb-4b50-b67c-fdb8da5013fe"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:21.295990 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:48:21.295990 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:48:21.305375 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-0a206820-277a-4333-a330-33630cfc297f req-d569ad6b-eacb-44ba-8567-f0e190c3733f service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:21.305902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-0a206820-277a-4333-a330-33630cfc297f req-d569ad6b-eacb-44ba-8567-f0e190c3733f service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:21.319728 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-0a206820-277a-4333-a330-33630cfc297f req-d569ad6b-eacb-44ba-8567-f0e190c3733f service nova] Creating event network-vif-plugged:f0d34555-bccb-4b50-b67c-fdb8da5013fe for instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 on hv-cinder-80660 Aug 31 13:48:21.324913 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-0a206820-277a-4333-a330-33630cfc297f req-d569ad6b-eacb-44ba-8567-f0e190c3733f service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034630 Aug 31 13:48:21.325549 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 615/1201] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:48:21 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:48:22.109653 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:22.110275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:22.116920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:22.117364 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:22.118112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:22.118534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:22.186370 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:22.187093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:22.198179 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:22.198624 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:22.199404 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:22.199837 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:22.250118 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:22.258913 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-60674398-4d38-42ac-bc8b-5da106b02066 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.152525 Aug 31 13:48:22.259502 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 587/1202] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:22 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:22.339001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:22.349373 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-66cc471d-a1f0-4f2f-a727-231229d1ef55 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.167770 Aug 31 13:48:22.349955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 616/1203] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:22 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:23.276263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:23.277001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:23.283007 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:23.283461 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:23.284224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:23.284687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:23.367386 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:23.368009 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:23.374707 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:23.375259 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:23.376211 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:23.376806 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:23.420678 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:23.428927 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-589362c1-7f9a-4927-ae65-a23636a85014 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.156689 Aug 31 13:48:23.429499 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 588/1204] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:23 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:23.513665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:23.521596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-09b0c3e4-a9a5-4a70-b291-5d92f7a2e8f4 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.158142 Aug 31 13:48:23.522177 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 617/1205] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:23 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:24.448902 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:24.449534 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:24.459012 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:24.459724 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:24.460945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:24.461613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:24.538691 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:24.539271 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:24.545934 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:24.546307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:24.547071 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:24.547485 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:24.603302 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:24.610920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-1fde73f3-8463-440e-9301-b7c8a7a8618c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.168207 Aug 31 13:48:24.611512 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 589/1206] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:24 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:24.673510 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:24.681646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ea188d02-53c2-45a4-97e5-3440f6b57537 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.146863 Aug 31 13:48:24.682260 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 618/1207] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:24 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:48:25.630806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:25.631439 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:25.638656 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:25.639152 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:25.639981 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:25.640568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:25.698466 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:25.699068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:25.705106 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:25.705751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:25.706820 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:25.707202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:25.774436 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:25.782214 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2c1d1d37-d36f-488a-8d33-a55ab44c8937 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.157671 Aug 31 13:48:25.783026 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 590/1208] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:25 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:25.839847 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:25.848879 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a8fcf3ac-0ebe-43a4-92af-cbea738b2c6e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.153682 Aug 31 13:48:25.858315 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 619/1209] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:25 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:26.801728 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:26.802449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:26.809575 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:26.810242 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:26.811041 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:26.811469 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:26.872183 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:26.873170 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:26.882125 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:26.882980 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:26.883846 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:26.884278 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:26.975446 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:26.984869 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2b69bee5-95ec-4dec-a569-2839ed4fb940 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1266 microversion: 2.1 time: 0.187613 Aug 31 13:48:26.985507 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 591/1210] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:26 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:27.335230 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:27.344815 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-bc3a0cbb-eb29-4837-810e-d5cf15b54ca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.480103 Aug 31 13:48:27.345415 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 620/1211] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:26 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 484 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:28.010048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:28.010733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:28.017023 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:28.017465 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:28.018231 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:28.018652 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:28.166224 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:28.173695 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2eb8106a-e746-441b-b996-92333ed1e47d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1452 microversion: 2.1 time: 0.167413 Aug 31 13:48:28.174297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 592/1212] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:28 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1452 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:28.189751 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:28.190356 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:28.197090 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:28.197543 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:28.198307 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:28.198740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:28.334955 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:28.347937 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-88bf460b-ffc9-41ac-88ac-7e39f163724a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1452 microversion: 2.1 time: 0.161164 Aug 31 13:48:28.348433 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 621/1213] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:28 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:28.362914 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:28.363884 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:28.370533 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:28.370978 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:28.371804 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:28.372158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:28.497597 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:28.505757 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f8904069-30a5-4331-9ef9-645eb9ef11d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.146745 Aug 31 13:48:28.506570 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 593/1214] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:28 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:29.524341 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:29.524987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:29.530999 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:29.531431 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:29.532190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:29.532831 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:29.680905 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:29.690378 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-afe27ab0-28da-4264-bb01-9856d348129f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.169884 Aug 31 13:48:29.691089 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 622/1215] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:29 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:30.406116 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-a0357569-60e2-4ec5-a1df-a14d3c0dedb6 req-47ee34b2-a04c-4ad3-a50c-3e8a9077305e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493cb2a1-d0f0-43dd-a01f-b65f048239b1", "tag": "f0d34555-bccb-4b50-b67c-fdb8da5013fe"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:30.407801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:48:30.407801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:48:30.415371 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-a0357569-60e2-4ec5-a1df-a14d3c0dedb6 req-47ee34b2-a04c-4ad3-a50c-3e8a9077305e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:30.415808 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-a0357569-60e2-4ec5-a1df-a14d3c0dedb6 req-47ee34b2-a04c-4ad3-a50c-3e8a9077305e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:30.427753 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-a0357569-60e2-4ec5-a1df-a14d3c0dedb6 req-47ee34b2-a04c-4ad3-a50c-3e8a9077305e service nova] Creating event network-changed:f0d34555-bccb-4b50-b67c-fdb8da5013fe for instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 on hv-cinder-80660 Aug 31 13:48:30.433181 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-a0357569-60e2-4ec5-a1df-a14d3c0dedb6 req-47ee34b2-a04c-4ad3-a50c-3e8a9077305e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030860 Aug 31 13:48:30.433930 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 594/1216] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:48:30 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:48:30.708644 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:30.710352 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:30.717686 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:30.718231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:30.719212 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:30.719616 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:30.869182 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:30.887634 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b2fcef27-114c-4d54-bfe5-2c9d2d203023 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.183739 Aug 31 13:48:30.888569 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 623/1217] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:30 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:31.907952 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:31.908920 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:31.915880 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:31.916329 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:31.917161 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:31.917597 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:32.065710 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:32.073703 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-a9e5d1e8-963a-4c7a-9900-a1a394f16e33 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.171238 Aug 31 13:48:32.074272 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 595/1218] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:31 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:33.100966 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:33.101764 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:33.109288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:33.109885 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:33.110774 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:33.111385 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:33.251902 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:33.259615 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5126e20e-fcc0-4c37-a54f-8b33955e0003 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.165437 Aug 31 13:48:33.260202 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 624/1219] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:33 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:34.280699 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:34.281380 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:34.290264 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:34.290893 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:34.291521 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:34.291945 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:34.436449 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:34.449900 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-d48c0d1f-a589-4b89-981b-c9dacc37add1 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.175634 Aug 31 13:48:34.450767 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 596/1220] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:34 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:35.470208 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:35.471004 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:35.479184 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:35.479645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:35.480445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:35.480876 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:35.630126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:35.639629 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-229b39b1-ea81-49f2-a338-8a3ac5db9560 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.175164 Aug 31 13:48:35.640204 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 625/1221] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:35 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:36.657592 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:36.658393 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:36.667817 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:36.668505 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:36.669671 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:36.670287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:36.810633 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:36.825806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-ffa6d01e-abd7-4c0f-b23b-ab07b9e215fc tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.172342 Aug 31 13:48:36.826759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 597/1222] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:36 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:37.851848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:37.853091 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:37.859769 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:37.860217 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:37.861037 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:37.861467 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:37.993669 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:38.002190 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-266d63ab-b760-4cad-955e-7f2ffeb862b6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.156559 Aug 31 13:48:38.002777 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 626/1223] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:37 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:39.020286 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:39.020986 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:39.027845 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:39.028291 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:39.029112 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:39.029538 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:39.173685 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:39.181736 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4111126b-3a8b-46ab-839a-9534ebceb3f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.165411 Aug 31 13:48:39.182308 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 598/1224] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:39 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:40.206865 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:40.207440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:40.215335 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:40.215866 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:40.217104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:40.217700 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:40.369589 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:40.378443 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5e360c3b-ff35-498d-b68b-dcd2e8c088a0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.175497 Aug 31 13:48:40.379021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 627/1225] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:40 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:41.396430 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:41.397051 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:41.403849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:41.404297 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:41.405054 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:41.405552 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:41.702047 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:41.712875 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-3c093d2d-1058-46e0-ad84-08fdfbec73fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.320054 Aug 31 13:48:41.713722 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 599/1226] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:41 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:42.734531 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:42.735188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:42.741409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:42.741840 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:42.742606 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:42.743031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:42.799307 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-5c23ba0e-c4bc-46a2-b278-b409e508e38d req-90194668-545c-47b1-b61f-252546bc9e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "name": "network-vif-plugged", "status": "completed", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:42.801200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:48:42.801200 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:48:42.804874 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f175e8b-b6b3-4d41-a39a-9c3e7ddc52f2] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 13:48:42.811039 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-5c23ba0e-c4bc-46a2-b278-b409e508e38d req-90194668-545c-47b1-b61f-252546bc9e8a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:42.811627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-5c23ba0e-c4bc-46a2-b278-b409e508e38d req-90194668-545c-47b1-b61f-252546bc9e8a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:42.823287 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-5c23ba0e-c4bc-46a2-b278-b409e508e38d req-90194668-545c-47b1-b61f-252546bc9e8a service nova] Creating event network-vif-plugged:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:48:42.829173 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-5c23ba0e-c4bc-46a2-b278-b409e508e38d req-90194668-545c-47b1-b61f-252546bc9e8a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042740 Aug 31 13:48:42.830427 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 600/1227] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:48:42 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:48:42.878477 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:42.886157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-f2e978dc-173f-4d73-be0d-9642b2b0689a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.155370 Aug 31 13:48:42.886746 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 628/1228] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:42 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:43.913330 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:43.914030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:43.922074 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:43.922527 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:43.923300 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:43.923721 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:43.929106 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f175e8b-b6b3-4d41-a39a-9c3e7ddc52f2] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 50510. Aug 31 13:48:44.069163 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:44.085416 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-26c9e2fe-ff25-4b17-83ce-0b06fdb88af9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1260 microversion: 2.1 time: 0.185138 Aug 31 13:48:44.086245 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 601/1229] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:43 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1260 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:45.104545 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a6e3d4a1-b876-43d0-8c66-920f5a6e1eba] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 13:48:45.108877 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:45.109506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:45.116113 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:45.116584 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:45.117341 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:45.117768 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:45.259070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:45.269525 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-00ab1e41-e6e2-45cc-a00f-3748e15616d9 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1444 microversion: 2.1 time: 0.167366 Aug 31 13:48:45.270091 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 629/1230] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:45 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1444 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:48:45.294565 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:48:45.295288 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:48:45.301485 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:45.301924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:45.302675 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:45.303098 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:45.435510 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:48:45.447881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-e3dc8d01-eb1b-453e-9294-c24ac980ec86 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1444 microversion: 2.1 time: 0.159032 Aug 31 13:48:45.448613 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 602/1231] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:48:45 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1444 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:48:47.691647 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-842634dc-86ef-4ae7-8d89-14866fd19d2b req-99e571d5-3734-4525-8d51-e3f58b2de64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:48:47.693298 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:48:47.693298 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:48:47.712789 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-842634dc-86ef-4ae7-8d89-14866fd19d2b req-99e571d5-3734-4525-8d51-e3f58b2de64d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:48:47.713231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-842634dc-86ef-4ae7-8d89-14866fd19d2b req-99e571d5-3734-4525-8d51-e3f58b2de64d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:48:47.726429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-842634dc-86ef-4ae7-8d89-14866fd19d2b req-99e571d5-3734-4525-8d51-e3f58b2de64d service nova] Creating event network-changed:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:48:47.731883 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-842634dc-86ef-4ae7-8d89-14866fd19d2b req-99e571d5-3734-4525-8d51-e3f58b2de64d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043819 Aug 31 13:48:47.732799 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 630/1232] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:48:47 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:49:16.980001 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:49:16.980793 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:49:16 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:50:37.974273 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:50:37.975053 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:50:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:50:39.117360 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:50:39.118034 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: Tue Aug 31 13:50:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:50:43.178557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:50:43.179215 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:43.185238 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:43.185687 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:43.186452 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:43.186877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:43.216030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lazy-loading 'flavor' on Instance uuid a538cad2-bee3-46d4-968c-852e3275209c {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:50:43.302295 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b796b74b-5f17-456c-83a5-536ff0e65952 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "POST /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c/action" status: 202 len: 0 microversion: 2.1 time: 0.130494 Aug 31 13:50:43.303160 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 603/1233] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:50:43 2021] POST /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c/action => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:50:43.310099 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] [a6e3d4a1-b876-43d0-8c66-920f5a6e1eba] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 50526. Aug 31 13:50:43.314056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:43.314749 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:43.322370 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:43.322788 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:43.323643 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:43.324238 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:43.589313 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:43.600246 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-db58302d-eb61-450c-a3ec-15c09c80aa9f tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.292109 Aug 31 13:50:43.600839 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 631/1234] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:43 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 31 13:50:44.619631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:44.620331 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:44.628882 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:44.629454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:44.630524 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:44.631082 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:44.839225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:44.849105 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c330c25b-3b3a-4670-ab8d-85114b13b08c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.234676 Aug 31 13:50:44.849907 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 604/1235] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:44 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:45.870156 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:45.870922 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:45.880321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:45.881002 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:45.881853 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:45.882289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:46.009222 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:46.016807 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-43264984-fe5b-4fba-9d88-785367649268 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.152662 Aug 31 13:50:46.017962 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 632/1236] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:45 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:47.039289 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:47.041032 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:47.051677 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:47.052661 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:47.053663 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:47.054095 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:47.196933 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:47.206867 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b28bc417-64a7-4b68-854d-8b5e4a2b6323 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.173877 Aug 31 13:50:47.207617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 605/1237] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:47 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:48.227068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:48.227685 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:48.235128 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:48.235629 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:48.236529 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:48.237021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:48.378279 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:48.386377 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-407fb4e3-e348-4144-bb0f-93e018846a29 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.163724 Aug 31 13:50:48.386988 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 633/1238] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:48 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:49.408630 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:49.409679 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:49.417752 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:49.418197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:49.418965 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:49.419395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:49.560849 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:49.571659 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-67f6c301-79f8-4b7f-afbf-96665c8cae40 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.169598 Aug 31 13:50:49.572249 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 606/1239] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:49 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:50.590623 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:50.591198 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:50.597688 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:50.598134 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:50.598894 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:50.599324 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:50.753826 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:50.765429 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a2310aaf-8130-482a-a1e4-83fb609496e5 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.179297 Aug 31 13:50:50.766285 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 634/1240] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:50 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:51.787937 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:51.788732 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:51.795917 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:51.796400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:51.797177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:51.797608 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:51.936489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:51.944631 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4b2ac88c-a738-477f-b53e-8644c6caf6f2 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.162329 Aug 31 13:50:51.945210 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 607/1241] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:51 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:52.460801 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:50:52.461144 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: Tue Aug 31 13:50:52 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:50:52.962730 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:52.963321 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:52.969668 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:52.970104 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:52.970866 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:52.971288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:53.109770 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:53.122148 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-a2b45f9a-9be1-4335-845f-eae0a4066b4e tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.162867 Aug 31 13:50:53.123351 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 635/1242] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:52 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:54.147806 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:54.148954 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:54.159515 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:54.160256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:54.161546 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:54.162428 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:54.294333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:54.302415 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-485d932e-3630-48be-8a9b-95208f60411c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.160830 Aug 31 13:50:54.303065 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 608/1243] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:54 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:55.321997 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:55.322777 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:55.329413 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:55.329824 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:55.330601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:55.331021 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:55.468484 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:55.485031 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-33985c92-55f3-4c2e-9698-6e2171d02497 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.167439 Aug 31 13:50:55.485657 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 636/1244] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:55 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:56.510956 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:56.512343 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:56.522395 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:56.523052 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:56.524245 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:56.524932 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:56.659689 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:56.668420 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-6dd5779b-2aad-44b4-8039-ed7eef1865d0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1509 microversion: 2.1 time: 0.163132 Aug 31 13:50:56.669041 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 609/1245] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:56 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:56.685533 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:50:56.686288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:56.693963 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:56.694689 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:56.695903 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:56.696574 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:56.848614 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-98375fa2-bed1-473a-9c89-33eb94b6e2cb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "POST /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c/action" status: 202 len: 0 microversion: 2.1 time: 0.167228 Aug 31 13:50:56.849144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 637/1246] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:50:56 2021] POST /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c/action => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:50:56.857467 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:56.858144 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:56.864226 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:56.864702 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:56.865468 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:56.865888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:56.998713 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:57.006682 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-bb07a588-5477-4cbe-a1ff-be65c070d4bb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1517 microversion: 2.1 time: 0.153188 Aug 31 13:50:57.007268 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 610/1247] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:56 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1517 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:58.025188 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:58.025713 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:58.032463 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:58.032944 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:58.033718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:58.034148 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:58.168397 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:58.176282 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-fdee53fb-eea9-49a1-8191-a8a53fde1643 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1519 microversion: 2.1 time: 0.155065 Aug 31 13:50:58.176900 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 638/1248] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:58 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:59.194705 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:50:59.195309 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:50:59.202146 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:59.202590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:59.203339 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:59.203759 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:59.342881 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:50:59.354408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-53804575-36b5-4092-abcf-a1430d20241b tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.163235 Aug 31 13:50:59.355158 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 611/1249] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:50:59 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:50:59.633015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-f86ea235-a6fe-4d6f-a042-cc4fc1001858 req-397893cd-6e88-487b-b320-e418f0d443fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "name": "network-vif-unplugged", "status": "completed", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:50:59.634555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:50:59.634555 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:50:59.643149 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-f86ea235-a6fe-4d6f-a042-cc4fc1001858 req-397893cd-6e88-487b-b320-e418f0d443fc service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:50:59.644036 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-f86ea235-a6fe-4d6f-a042-cc4fc1001858 req-397893cd-6e88-487b-b320-e418f0d443fc service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:50:59.655431 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-f86ea235-a6fe-4d6f-a042-cc4fc1001858 req-397893cd-6e88-487b-b320-e418f0d443fc service nova] Creating event network-vif-unplugged:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:50:59.661023 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-f86ea235-a6fe-4d6f-a042-cc4fc1001858 req-397893cd-6e88-487b-b320-e418f0d443fc service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104803 Aug 31 13:50:59.661620 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 639/1250] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:50:59 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:51:00.372583 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:00.373489 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:00.380333 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:00.380798 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:00.381555 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:00.381976 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:00.522282 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:00.530733 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-25bfa40a-5e36-431b-b79f-763481d05717 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.161949 Aug 31 13:51:00.531303 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 612/1251] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:00 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:01.549242 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:01.549844 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:01.556797 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:01.557258 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:01.558012 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:01.558457 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:01.696209 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:01.705592 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-10ca40fd-7468-43b6-8c0a-4c87aa1066fb tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.160569 Aug 31 13:51:01.706129 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 640/1252] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:01 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:02.723360 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:02.723969 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:02.731397 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:02.731923 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:02.733179 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:02.733818 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:02.870405 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:02.878568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-dbf6eb13-cfbf-4d9c-81e3-224f964a66ca tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.158923 Aug 31 13:51:02.879020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 613/1253] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:02 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:03.897249 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:03.897868 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:03.904283 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:03.904792 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:03.905580 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:03.905964 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:04.039688 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:04.048470 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-998a9bd5-d3e3-4d55-a86a-ab68461bf682 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.155024 Aug 31 13:51:04.049068 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 641/1254] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:03 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:05.066811 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:05.067463 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:05.074470 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:05.074921 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:05.075685 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:05.076108 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:05.213946 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:05.222833 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-b865120c-5100-41ff-9c2a-f1e4be6d2f03 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.159796 Aug 31 13:51:05.223767 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 614/1255] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:05 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:06.240330 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:06.240953 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:06.248782 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:06.249224 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:06.250000 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:06.250426 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:06.387461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:06.396328 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-d012fd49-21d3-4af3-8076-5484bf365375 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1575 microversion: 2.1 time: 0.159875 Aug 31 13:51:06.397665 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 642/1256] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:06 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:07.413877 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:51:07.414545 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:51:07.421205 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:07.421650 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:07.422445 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:07.422870 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:07.578396 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:51:07.587572 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-0147852b-1dea-4de9-ae38-8d5ba9f49718 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1562 microversion: 2.1 time: 0.177271 Aug 31 13:51:07.588138 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 615/1257] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:51:07 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1562 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:51:09.705567 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-d693e511-184b-442e-b1a0-72f2f037296b req-c71b08e0-0159-4452-97b4-997b2b6e10fd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "name": "network-vif-plugged", "status": "completed", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:51:09.707087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:51:09.707087 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:51:09.714646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d693e511-184b-442e-b1a0-72f2f037296b req-c71b08e0-0159-4452-97b4-997b2b6e10fd service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:51:09.715082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-d693e511-184b-442e-b1a0-72f2f037296b req-c71b08e0-0159-4452-97b4-997b2b6e10fd service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:51:09.727771 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-d693e511-184b-442e-b1a0-72f2f037296b req-c71b08e0-0159-4452-97b4-997b2b6e10fd service nova] Creating event network-vif-plugged:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:51:09.733184 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-d693e511-184b-442e-b1a0-72f2f037296b req-c71b08e0-0159-4452-97b4-997b2b6e10fd service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031412 Aug 31 13:51:09.734093 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 643/1258] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:51:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:52:03.822602 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:03.823557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:03.826177 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: ERROR oslo.messaging._drivers.impl_rabbit [-] [5f175e8b-b6b3-4d41-a39a-9c3e7ddc52f2] AMQP server on 10.222.0.21:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 31 13:52:03.831118 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:03.831590 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:03.832402 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:03.832839 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:04.849194 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] [5f175e8b-b6b3-4d41-a39a-9c3e7ddc52f2] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 50698. Aug 31 13:52:04.852925 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-4da8f3f4-ae33-4f8b-bbce-6a2eae06673c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "POST /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1/action" status: 200 len: 14 microversion: 2.1 time: 1.034356 Aug 31 13:52:04.853557 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 616/1259] 10.222.0.21 () {60 vars in 1278 bytes} [Tue Aug 31 13:52:03 2021] POST /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1/action => generated 14 bytes in 1036 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 31 13:52:06.111410 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:06.112051 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:06.119848 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:06.120417 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:06.127409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:06.127409 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:06.153445 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Going to try to terminate instance {{(pid=120181) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:52:06.248961 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-c9c43747-4671-444b-a9ee-879e3c23c98a tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 204 len: 0 microversion: 2.1 time: 0.142760 Aug 31 13:52:06.251274 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 644/1260] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:52:06 2021] DELETE /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:52:06.259440 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:06.260193 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:06.262385 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-5ebb36dd-d727-4b57-8d74-df1e30510b74 req-1b03bad6-99d1-48e4-9cf1-74f6667cf76e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "493cb2a1-d0f0-43dd-a01f-b65f048239b1", "tag": "f0d34555-bccb-4b50-b67c-fdb8da5013fe"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:06.263938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:52:06.263938 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:52:06.266645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:06.267082 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:06.268056 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:06.268502 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:06.271462 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-5ebb36dd-d727-4b57-8d74-df1e30510b74 req-1b03bad6-99d1-48e4-9cf1-74f6667cf76e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:06.271979 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-5ebb36dd-d727-4b57-8d74-df1e30510b74 req-1b03bad6-99d1-48e4-9cf1-74f6667cf76e service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:06.284911 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-5ebb36dd-d727-4b57-8d74-df1e30510b74 req-1b03bad6-99d1-48e4-9cf1-74f6667cf76e service nova] Creating event network-changed:f0d34555-bccb-4b50-b67c-fdb8da5013fe for instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 on hv-cinder-80660 Aug 31 13:52:06.292191 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-5ebb36dd-d727-4b57-8d74-df1e30510b74 req-1b03bad6-99d1-48e4-9cf1-74f6667cf76e service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.181664 Aug 31 13:52:06.296232 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 617/1261] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:52:06 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:52:06.405158 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:06.412718 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-b251d905-41e0-4ad5-bc5b-12bb98c9815c tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1576 microversion: 2.1 time: 0.158058 Aug 31 13:52:06.413480 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 645/1262] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:06 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:07.432742 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:07.433409 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:07.440246 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:07.440721 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:07.441492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:07.441925 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:07.576967 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:07.587086 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-c439ab4f-d078-46b7-b92f-a4987dd06360 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1458 microversion: 2.1 time: 0.158637 Aug 31 13:52:07.588020 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 618/1263] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:07 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:08.615518 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:08.616157 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:08.624126 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:08.624606 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:08.625596 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:08.626064 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:08.655168 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-7cab634c-a081-4a02-a5e3-5b03ae016b8b req-49193ab3-e0d2-4b7a-8088-fbf2c93b86ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "493cb2a1-d0f0-43dd-a01f-b65f048239b1", "name": "network-vif-deleted", "tag": "f0d34555-bccb-4b50-b67c-fdb8da5013fe"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:08.661425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:52:08.661425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:52:08.673478 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-7cab634c-a081-4a02-a5e3-5b03ae016b8b req-49193ab3-e0d2-4b7a-8088-fbf2c93b86ff service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:08.674031 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-7cab634c-a081-4a02-a5e3-5b03ae016b8b req-49193ab3-e0d2-4b7a-8088-fbf2c93b86ff service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:08.690197 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-7cab634c-a081-4a02-a5e3-5b03ae016b8b req-49193ab3-e0d2-4b7a-8088-fbf2c93b86ff service nova] Creating event network-vif-deleted:f0d34555-bccb-4b50-b67c-fdb8da5013fe for instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 on hv-cinder-80660 Aug 31 13:52:08.698554 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-7cab634c-a081-4a02-a5e3-5b03ae016b8b req-49193ab3-e0d2-4b7a-8088-fbf2c93b86ff service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046818 Aug 31 13:52:08.699209 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 619/1264] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:52:08 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:52:08.699372 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:08.708289 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-5eea361c-7eb8-4599-bc0b-c03efa0ede41 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1390 microversion: 2.1 time: 0.098958 Aug 31 13:52:08.709218 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 646/1265] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:08 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1390 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:09.729429 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:09.730690 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:09.738496 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:09.739137 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:09.740514 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:09.741093 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:09.777145 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:09.777851 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:09.778694 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.objects.instance [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lazy-loading 'fault' on Instance uuid 493cb2a1-d0f0-43dd-a01f-b65f048239b1 {{(pid=120180) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1098}} Aug 31 13:52:09.834435 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:09.842298 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-df5ddf4c-9135-4654-9455-31f4c72364fc tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 200 len: 1184 microversion: 2.1 time: 0.119493 Aug 31 13:52:09.842888 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 620/1266] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:09 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 1184 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:10.862552 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:10.863256 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 493cb2a1-d0f0-43dd-a01f-b65f048239b1] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:10.871067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:10.871514 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:10.872286 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:10.872760 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:10.890600 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] HTTP exception thrown: Instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 could not be found. Aug 31 13:52:10.891389 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Returning 404 to user: Instance 493cb2a1-d0f0-43dd-a01f-b65f048239b1 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:52:10.892645 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-69c6f2cb-6871-416b-97a1-516f09554a4b tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1" status: 404 len: 111 microversion: 2.1 time: 0.035001 Aug 31 13:52:10.893171 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 647/1267] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:10 2021] GET /compute/v2.1/servers/493cb2a1-d0f0-43dd-a01f-b65f048239b1 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:52:14.078770 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:14.079342 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:14.086718 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:14.087168 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:14.087974 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:14.088408 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:14.116971 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:52:14.145627 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-f0afdc8c-658f-4c22-bbda-0349e421df1c req-9d2d3ff9-52b8-442e-92e9-8e7910738dbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "050856c4-86f9-4f1f-a482-b2503a93a0bf", "tag": "567e463b-a026-495f-bb7e-bbfaff1cc7c1"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:14.147319 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:52:14.147319 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:52:14.154946 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-f0afdc8c-658f-4c22-bbda-0349e421df1c req-9d2d3ff9-52b8-442e-92e9-8e7910738dbe service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:14.155487 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-f0afdc8c-658f-4c22-bbda-0349e421df1c req-9d2d3ff9-52b8-442e-92e9-8e7910738dbe service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:14.167430 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-f0afdc8c-658f-4c22-bbda-0349e421df1c req-9d2d3ff9-52b8-442e-92e9-8e7910738dbe service nova] Creating event network-changed:567e463b-a026-495f-bb7e-bbfaff1cc7c1 for instance 050856c4-86f9-4f1f-a482-b2503a93a0bf on hv-cinder-80660 Aug 31 13:52:14.173015 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-f0afdc8c-658f-4c22-bbda-0349e421df1c req-9d2d3ff9-52b8-442e-92e9-8e7910738dbe service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095445 Aug 31 13:52:14.174025 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 648/1268] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:52:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:52:14.212961 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-69d6a289-af34-4d14-984c-8c57b4f20744 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 204 len: 0 microversion: 2.1 time: 0.129730 Aug 31 13:52:14.214321 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 621/1269] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:52:14 2021] DELETE /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 31 13:52:14.223570 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:14.224454 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:14.231376 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:14.232124 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:14.233288 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:14.233801 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:14.368850 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:14.376761 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-335eeeab-522b-4e37-8dcd-ae6c5a22132d tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1577 microversion: 2.1 time: 0.157735 Aug 31 13:52:14.383040 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 649/1270] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:14 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:15.324262 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [req-13430232-7f2f-44bd-9785-7c4a9c2c4927 req-335c357e-0835-4051-8bed-489b74b0fc8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "050856c4-86f9-4f1f-a482-b2503a93a0bf", "name": "network-vif-deleted", "tag": "567e463b-a026-495f-bb7e-bbfaff1cc7c1"}]} {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:15.325776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:52:15.325776 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: warnings.warn(msg) Aug 31 13:52:15.333963 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-13430232-7f2f-44bd-9785-7c4a9c2c4927 req-335c357e-0835-4051-8bed-489b74b0fc8a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:15.334568 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [req-13430232-7f2f-44bd-9785-7c4a9c2c4927 req-335c357e-0835-4051-8bed-489b74b0fc8a service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:15.346048 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.compute.server_external_events [req-13430232-7f2f-44bd-9785-7c4a9c2c4927 req-335c357e-0835-4051-8bed-489b74b0fc8a service nova] Creating event network-vif-deleted:567e463b-a026-495f-bb7e-bbfaff1cc7c1 for instance 050856c4-86f9-4f1f-a482-b2503a93a0bf on hv-cinder-80660 Aug 31 13:52:15.350872 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [req-13430232-7f2f-44bd-9785-7c4a9c2c4927 req-335c357e-0835-4051-8bed-489b74b0fc8a service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031087 Aug 31 13:52:15.351378 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 622/1271] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:52:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 31 13:52:15.394259 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:15.394908 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:15.401184 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:15.401632 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:15.402402 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:15.402830 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:15.474731 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '83dc5c95f312476599549f1901dbe9ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fe0f9f3a4c9445aa52a0cd9c16de325', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:15.483070 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-660d81d0-d2c3-4aeb-8cd2-70f7dba56d51 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 200 len: 1225 microversion: 2.1 time: 0.092592 Aug 31 13:52:15.483646 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 650/1272] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:15 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:16.501187 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:16.501924 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 050856c4-86f9-4f1f-a482-b2503a93a0bf] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:16.512030 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:16.512782 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:16.514012 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:16.514715 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:16.537203 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] HTTP exception thrown: Instance 050856c4-86f9-4f1f-a482-b2503a93a0bf could not be found. Aug 31 13:52:16.538256 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Returning 404 to user: Instance 050856c4-86f9-4f1f-a482-b2503a93a0bf could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:52:16.539400 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-75f1ebb2-e350-4518-9566-83dcf54922c2 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf" status: 404 len: 111 microversion: 2.1 time: 0.042635 Aug 31 13:52:16.540503 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 623/1273] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:16 2021] GET /compute/v2.1/servers/050856c4-86f9-4f1f-a482-b2503a93a0bf => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:52:17.034892 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:17.035502 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:17.042379 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:17.043231 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:17.044020 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:17.044483 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:17.059461 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] HTTP exception thrown: Instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 could not be found. Aug 31 13:52:17.060066 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Returning 404 to user: Instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:52:17.060952 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-63161fe6-294f-426e-a9a9-d7a26fc36a9f tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "DELETE /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 404 len: 111 microversion: 2.1 time: 0.029969 Aug 31 13:52:17.061537 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 651/1274] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:52:17 2021] DELETE /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:52:17.069891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:17.070627 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [instance: 81610f93-fb19-4d2b-9ce6-2fb98e042bb8] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:17.077786 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:17.078225 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:17.079001 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:17.079425 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:17.096617 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.wsgi [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] HTTP exception thrown: Instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 could not be found. Aug 31 13:52:17.097561 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Returning 404 to user: Instance 81610f93-fb19-4d2b-9ce6-2fb98e042bb8 could not be found. {{(pid=120180) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:52:17.098389 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-f4556c71-d597-4307-9e7b-53de24962b8e tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8" status: 404 len: 111 microversion: 2.1 time: 0.032395 Aug 31 13:52:17.098939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 624/1275] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:17 2021] GET /compute/v2.1/servers/81610f93-fb19-4d2b-9ce6-2fb98e042bb8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:52:18.449560 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-208e7458-7640-4dae-bbe8-f78cb4555a69 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] Calling method '.version_select at 0x7f67f42b8040>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:18.452872 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: ERROR oslo.messaging._drivers.impl_rabbit [None req-208e7458-7640-4dae-bbe8-f78cb4555a69 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [eb36e1dc-c7a0-4d61-a3ab-10014166acf3] AMQP server on 10.222.0.21:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Aug 31 13:52:19.471896 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [None req-208e7458-7640-4dae-bbe8-f78cb4555a69 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] [eb36e1dc-c7a0-4d61-a3ab-10014166acf3] Reconnected to AMQP server on 10.222.0.21:5672 via [amqp] client with port 50772. Aug 31 13:52:19.495119 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-208e7458-7640-4dae-bbe8-f78cb4555a69 tempest-TestVolumeBootPattern-637613937 tempest-TestVolumeBootPattern-637613937-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1084113261" status: 202 len: 0 microversion: 2.1 time: 1.049555 Aug 31 13:52:19.495729 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 652/1276] 10.222.0.21 () {58 vars in 1263 bytes} [Tue Aug 31 13:52:18 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1084113261 => generated 0 bytes in 1051 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:52:24.141548 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:24.142084 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:24.148781 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:24.149539 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:24.150344 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:24.150739 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:24.152709 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-deb15f95-fbb9-4a8c-b0fd-70cd32f98b02 req-cddaa439-300e-4d9f-92c3-3ef3edeb3b6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:24.154692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:52:24.154692 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:52:24.170998 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-deb15f95-fbb9-4a8c-b0fd-70cd32f98b02 req-cddaa439-300e-4d9f-92c3-3ef3edeb3b6d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:24.171810 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-deb15f95-fbb9-4a8c-b0fd-70cd32f98b02 req-cddaa439-300e-4d9f-92c3-3ef3edeb3b6d service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:24.181109 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Going to try to terminate instance {{(pid=120180) delete /opt/stack/nova/nova/compute/api.py:2575}} Aug 31 13:52:24.189446 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-deb15f95-fbb9-4a8c-b0fd-70cd32f98b02 req-cddaa439-300e-4d9f-92c3-3ef3edeb3b6d service nova] Creating event network-changed:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:52:24.201877 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-deb15f95-fbb9-4a8c-b0fd-70cd32f98b02 req-cddaa439-300e-4d9f-92c3-3ef3edeb3b6d service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052275 Aug 31 13:52:24.210866 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 653/1277] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:52:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:52:24.289464 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-07e4203f-4788-41e6-8434-1032e3968147 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "DELETE /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 204 len: 0 microversion: 2.1 time: 0.151247 Aug 31 13:52:24.290492 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 625/1278] 10.222.0.21 () {58 vars in 1239 bytes} [Tue Aug 31 13:52:24 2021] DELETE /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 31 13:52:24.303142 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:24.304144 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:24.312812 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:24.313538 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:24.314525 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:24.315388 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:24.468626 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.policy [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120181) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:24.477506 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-56b0b23f-a2b2-43ed-a7f3-5f3a556a1ad0 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1568 microversion: 2.1 time: 0.180851 Aug 31 13:52:24.484855 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 654/1279] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:24 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1568 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:25.495039 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:25.496346 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:25.502774 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:25.503484 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:25.504273 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:25.504910 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:25.648245 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:25.660054 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-2e062f5c-bc18-4668-9127-ff17cfd1eca6 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1450 microversion: 2.1 time: 0.168914 Aug 31 13:52:25.661371 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 626/1280] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:25 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1450 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:26.490759 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [req-27a5f820-4fb9-43ac-9a42-d3da309cb92b req-17b8646a-d5c8-478c-8fa8-566dc0e7c784 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a538cad2-bee3-46d4-968c-852e3275209c", "name": "network-vif-deleted", "tag": "c4323bb5-596c-4dec-8971-b9ab1e10bbd7"}]} {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 31 13:52:26.492516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 31 13:52:26.492516 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: warnings.warn(msg) Aug 31 13:52:26.501401 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-27a5f820-4fb9-43ac-9a42-d3da309cb92b req-17b8646a-d5c8-478c-8fa8-566dc0e7c784 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:26.502220 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [req-27a5f820-4fb9-43ac-9a42-d3da309cb92b req-17b8646a-d5c8-478c-8fa8-566dc0e7c784 service nova] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:26.515551 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.compute.server_external_events [req-27a5f820-4fb9-43ac-9a42-d3da309cb92b req-17b8646a-d5c8-478c-8fa8-566dc0e7c784 service nova] Creating event network-vif-deleted:c4323bb5-596c-4dec-8971-b9ab1e10bbd7 for instance a538cad2-bee3-46d4-968c-852e3275209c on hv-cinder-80660 Aug 31 13:52:26.522165 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [req-27a5f820-4fb9-43ac-9a42-d3da309cb92b req-17b8646a-d5c8-478c-8fa8-566dc0e7c784 service nova] 10.222.0.21 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035573 Aug 31 13:52:26.523456 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 655/1281] 10.222.0.21 () {64 vars in 1318 bytes} [Tue Aug 31 13:52:26 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 31 13:52:26.677891 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:26.678508 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.compute.api [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120180) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:26.686010 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:26.686467 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:26.687263 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:26.687939 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG oslo_concurrency.lockutils [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120180) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:26.776404 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.policy [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f54416f992314a0db756001419024c54', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bbf3fe9318e24c7e9c50ba3a63ba6260', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120180) authorize /opt/stack/nova/nova/policy.py:199}} Aug 31 13:52:26.786407 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-793cbe1a-8108-4b62-a44a-6bace065715a tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 200 len: 1220 microversion: 2.1 time: 0.111504 Aug 31 13:52:26.796997 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 627/1282] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:26 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 1220 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 31 13:52:27.804101 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '>' {{(pid=120181) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:27.804939 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.compute.api [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] [instance: a538cad2-bee3-46d4-968c-852e3275209c] Fetching instance by UUID {{(pid=120181) get /opt/stack/nova/nova/compute/api.py:2826}} Aug 31 13:52:27.811291 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:27.811740 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:27.812601 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 31 13:52:27.813030 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG oslo_concurrency.lockutils [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Lock "29c8b651-663d-4ed1-81b4-a3ed2cff61f0" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120181) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 31 13:52:27.826598 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.wsgi [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] HTTP exception thrown: Instance a538cad2-bee3-46d4-968c-852e3275209c could not be found. Aug 31 13:52:27.827195 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: DEBUG nova.api.openstack.wsgi [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Returning 404 to user: Instance a538cad2-bee3-46d4-968c-852e3275209c could not be found. {{(pid=120181) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 31 13:52:27.828061 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO nova.api.openstack.requestlog [None req-ad5cc312-69d8-462b-aae6-394f9360f13c tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c" status: 404 len: 111 microversion: 2.1 time: 0.028077 Aug 31 13:52:27.828648 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: [pid: 120181|app: 0|req: 656/1283] 10.222.0.21 () {58 vars in 1236 bytes} [Tue Aug 31 13:52:27 2021] GET /compute/v2.1/servers/a538cad2-bee3-46d4-968c-852e3275209c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 31 13:52:27.999309 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: DEBUG nova.api.openstack.wsgi [None req-5722144f-8dcb-42a7-b02b-76c622028730 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] Calling method '.version_select at 0x7f67f41a4ee0>' {{(pid=120180) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 31 13:52:28.027454 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO nova.api.openstack.requestlog [None req-5722144f-8dcb-42a7-b02b-76c622028730 tempest-TestShelveInstance-1866677658 tempest-TestShelveInstance-1866677658-project] 10.222.0.21 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1503517526" status: 202 len: 0 microversion: 2.1 time: 0.033281 Aug 31 13:52:28.028275 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: [pid: 120180|app: 0|req: 628/1284] 10.222.0.21 () {58 vars in 1254 bytes} [Tue Aug 31 13:52:27 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1503517526 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 31 13:53:57.993320 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:53:57.993987 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:53:57 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:53:59.137711 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:53:59.138330 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: Tue Aug 31 13:53:59 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:57:18.012763 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:57:18.012763 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:57:18 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:57:19.160487 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:57:19.160487 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: Tue Aug 31 13:57:19 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:57:32.255540 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:57:32.256267 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: Tue Aug 31 13:57:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:57:32.491570 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:57:32.491570 dv-cinder-806605-3-iscsi devstack@n-api.service[120180]: Tue Aug 31 13:57:32 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:57:37.005018 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:57:37.006029 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:57:37 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 31 13:57:39.388067 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 31 13:57:39.389185 dv-cinder-806605-3-iscsi devstack@n-api.service[120181]: Tue Aug 31 13:57:39 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!